Embarassing ooops.... of course Ft Mc Henry. Rockets red glare etc.
The National Road (pike) runs from the port area and becomes US 40. It actually starts at the Bromo Seltzer Tower.
Perhaps you speak of the original starting point 200 years ago. Rte 40 is Mulberry St. right through the middle of town, continuing east all the way to Atlantic City.