Yep - other than the inner harbor, right across from the old stadium, it deteriorates quickly in any direction you care to go.
Too bad. Maybe one day the real estate prices will jump so high that only yuppies will be able to afford to live there.
Baltimore was originally settled for good reasons. I hope it gets reclaimed someday.