I'm having mine while I'm "too young", according to most people.
You can't make everyone happy, so please don't worry about the snarky comments you're bound to recieve.
I hope you can have the baby naturally, but I would urge you to consider adopting before IVF. It's just a personal bias, but alot of kids need good homes.
I won't have IVF and would adopt instead.