It shows a lack of respect for GOD and his church...
Once you loose respect you will never get people to understand the importance of your message....
How so? God's representatives on Earth shouldn't just hang out in the good parts of town. Does God want His message only to be heard in upper-middle-class suburbs? It seems like the biggest concern you have is that "respectable" people might be shocked by the fact that a clergyman is hanging out in bad joints.
How do you account for the fact that Jesus, were he alive today, might very well be hanging out in bars, strip clubs and crack houses?