It’s worse if the country you are expatriating to has a tax treaty with the US. Basically, those countries act as local IRS offices, with even casinos reporting winnings to the IRS just as they do to their local revenue offices.
I cannot strongly caution enough, however, to consider all ramifications of surrendering that citizenship. For all the faults of anything else, the US is still the most powerful international player in the known universe. Giving up those rights and protections is a major, major decision and not at all to be taken lightly or rashly.