Maybe not. What if we are inside a gravastar?
Good question. My next door neighbor said something long time ago that stuck with me - "how big is big"? In other words, what seems enormous to us may be nothing compared to something else. What he meant was it's possible we're just beings inside some other life form, and if that's the case the universe would not be infinite.