"If you have all matter in the inverse compressed into a tiny speck because that is all the room there is for the matter to be in, when you give the matter more space, the mattr will expand outward due to pressure to fill the additional space." Incorrect. Your above view ascribes a Force to space.
Identify this Force or else admit your error.