It just feels that way when you have tons of water above you
I thought maybe the pressure compresses your body tissues thereby making you more dense...in other words, less buoyant.