Half the group are below the Median, not average. In a large population the average and median become almost the same number.
Consider the following group of 5 test scores: 100, 100, 25, 25, 25. The Average is 275/5, or 55. Note that 60% of the scores are below average.