Neandertal brains were significantly larger than ours — however, they also had more rugged bodies, and a larger nervous system is needed just to generate the juice to make everything move. Whether the genes get passed down would be reliant on random chance. :^o
It would still be a very fun study.