No, infertility is not always a woman's problem. Both women and men can have problems that cause infertility. About one-third of infertility cases are caused by women's problems. Another one third of fertility problems are due to the man. The other cases are caused by a mixture of male and female problems or by unknown problems.
This answer is based on source information from the National Women's Health Information.