I've been to Bacchanalia, and yes the place is excellent. But in New York City, Boston, Chicago, and other first class cities you will find dozens of restaurants of that caliber and not just a handful.
When I travel, I go out of my way to visit neighborhoods and to stay away from the business and tourist districts. But unlike NYC and Boston, for example, there aren't any decent neighborhood hotels in Atlanta. You can stay downtown which is deadtown after 7:00 p.m., or near Peachtree Center, which is more corporate than neighborhood, or in Buckhead, where the good hotels are attached to shopping malls and the real Buckhead is a $12 taxi ride away. Even in Mid-town Manhattan or Backbay or the Financial District in Boston, the neighborhoods and all they have to offer are only a few blocks walk.