The few original coins and drawings that survive show Cleopatra looking rather ugly with a big hooked nose.
She was the key to controlling the richest food source the Roman empire had access to. That had a lot to do with her attractiveness.
The reputation of her as a seductress was Octavian’s best bet to get the support of the Roman public (who hated Cleopatra but loved Marc Antony). Lots of history is merely political propaganda that stands the test of time- especially when the public want to believe it.
She was well past her prime at that point,=.