The rise in unaffiliated is just a reflection of how many liberal denominations have run off their supporters. For example, many PCUSA churches are now unaffiliated. Same with American Baptist. On and on. That does not necessarily mean anything more.
I think you have a point.