Do all mushrooms have that feature?......................
Yes. The cap and stem you see are only the fruit of the actual fungus mycelium, which is the web that grows under the ground or in the rotting wood.