I would say there is some truth to that, even if it’s incomplete. To most blacks, going to church is their highlight of the week. Many whites do treat going to church as if it’s an interruption to their week.
It was part of his explanation why blacks and whites have self segregated beginning in the churches and it carries over into the rest of life. He says that he believes the sense of community begins in church and points out that the word “community” comes from Commune as in communion.
When it comes right down to it, nobody wants a neighbor they wouldn’t feel comfortable going to church with.