I have three kids. I can tell you first hand that
you don't know what you are missing. I have a few friends who have been married for a long time without children. They say things are fine. But, as someone who lived a two-person world for several years then had three kids, seriously, you have no idea what you are missing. Kids are more wonderful then you can imagine.
If I were you, I would go out of my ways to get pregnant, even if it means having sex with another man.