The ruling elite may have converted to Judaism, not the entire realm which remained with multiple religions.
Actually, a good portion of the population did convert. The Rabbi made records, all Rabbis are required to, which is how we know who the Rabbi was, and who the people were.