The little yellow church, President’s church, right across the street from Lafayette Park is a must visit.
I attended a service there in 1969. However, be forwarned--it's an Episcopalian church, and it's in DC, so the sermons will not likely reflect the viewpoint of John Hagee or Franklin Graham.