Housing in Fairfield county is very expensive. Most people who are not highly-paid live in less expensive communities, but the commuting traffic is terrible.
If you give more info about your situation, I might be able to give further advice.
From a friend that moved there a couple of years ago complaint was housing cost and heating cost.