Only 35% of LDS members world wide are active in the church at all, from some recent estimates.
You might be surprised at how few ward members actually hold or have held Temple Recommends. I doubt if it is 1/2 of the adults. This is information I received from my brother who is serving in his Bishopric.
It may have just been the wards I was in. :)