I am not a speed-freak to the point of trying to spend hours optimizing the compiler settings for programs. What I find attractive is Portage, which does, IMHO, a phenomenal job managing software.
i never tried gentoo i'll have to give it a shot sometime. :)