Obviously construction standards were inferior to modern ones and no aerial photography or NOAA existed in 1900. All we have to go on is the after pictures and death tolls. Andrew was a massive category 5 storm with reports of automobile-sized holes found in the remains of walls of buildings. Thankfully, my area of the central Florida coast escaped the worst of the storm. It was the worst hurricane ever reported on the Atlantic coast of Florida, according to the NMOAA videos I linked above.
Worst for that area, but not the “worst” for the US, or even Florida in general, I believe.
Labor Day Hurricane of 1935—The most powerful hurricane to make landfall in the United States. A very small storm, this Category Five Hurricane tore through the Florida Keys with 180 mph winds, and a low pressure of 26.35 inches of Hg.
http://www.hurricaneville.com/1935_hurricane.html