Yeah that seemed to be common consensus about Panama when I heard about some years ago. I was surprised to hear it at first, but the infrastructure and surroundings seem to be surprisingly high-quality, plus friendly people and great beaches. Are most people going to Panama City or some of the smaller coastal towns?
Panama City is more advanced (and safer) than Colon. Lots of ex-pats buy land by elevation/temperature and build on it, but that gets very sticky. (Panama has 10,000’ high mountains!)
As in many Central American countries, you can buy a fantastic property, but getting the contruction materials and crew out to it is the hard part. The easiest and safest way to go is to buy an existing condo in a secure suburban area. There is a high wall around the entire block, with security at the entry point from the street. This allows you to leave the country without worrying (much) about your home being robbed or looted while you are gone.
The cost of living is cheap and the quality of life is high in Panama. Panama got a big “head start” on the rest of Central America due to the canal and canal zone.