"Actually, as a percentage of the population your growing the fastest.
"
Yeah, but the non-religious don't make up any sort of voting bloc. They're all over the map, politically, so there's no way to manipulate them as a bloc.
I have to keep in mind that this data is from a fairly large poll, not from any actual membership stats. It's a large sample, though, so I suspect that its numbers are fairly close.