I can fully empathize with you.. I'm a single woman; been divorced for 30 years and never remarried (by choice I might add) but the members of my church, including the pastor, treat me as some kind of pariah or that something is very wrong with me. It is infuriating actually. I've seen infidelity in the church; the wives airing all their dirty laundry about their 'cheating' husbands in front of the whole church (talk about dysfunction) and yet, I'm eyed with suspicion or disdain. It's extremely uncomfortable and like you, I no longer attend. I don't know what the answer is and really not sure there is one given the fact that we are human. I wish you luck. For now though, in my own life, I will stay at home and read His Word and stay in prayer.
Personally, I believe both of us should find a church. It's all about trying to be closer to our Lord. I believe a good church can help us with that.
It's a shame we both feel uncomfortable going church because we don't feel that we fit "the profile." Fortunately for me, Christ is accepting of some "dysfunctional" folks (not married with the 2.2 children).
I may feel a little uncomfortable going to church alone but I also realize that our savior paid a great price for us. I guess I need to get over the pettiness of my "slight discomfort" and find a place that's right for me. Hopefully we can both find a place that is good for us.