Montego Bay immediate area is not as much of a really popular resort area like Negril and Ocho Rios which have nicer beaches and more resorts.
And of course, NO ONE goes to the capital, Kingston.
Our ship moored there for a couple of days on one of our Caribbean deployments, back in 1962, '63 or '64. Waterfront dive bars with nautical names were the main feature, IIRC. Don't recall feeling unsafe.