No time to check sources this morning, but that seems likely an awfully high figure. I know the Justinian Plague was devastating, but might this figure be for repeated occurances over several centuries?
Here’s one reference that cites the “100 million” figure:
http://www.ph.ucla.edu/epi/bioter/anempiresepidemic.html