House buying

One thing I learned during the whole infertility process is not to live as if you are going to get pregnant.
So... A and I are considering buying a 2-bedroom house even though we really want a 3-bedroom. It's in a good location and has all the other features we want, and we three bedrooms for two people is really a luxury, even though it would be handy when we have guests.
But we are also planning to try IVF for the first time this spring. Does that make buying a 2-bedroom house foolish?