Speaking from sad experience of driving north on US-301 many years ago (speeds may have changed since.) As you enter Waldo, you go from 2 lanes each way divided into a tight curve where the speed drops from 55 to 25 and the police are at that curve with their radar. You have almost no chance to slow if you are not a native and know the conditions.
That’s not the case anymore, and hasn’t been for quite some time. The speed limits and signage in Waldo aren’t at all unreasonable.
You can take a look yourself, if you like. Google Street View and click your way through the town.