I do too.
However...and this may be over simplistic...I think that the simplest explanation is the most likely. Floyd is unnerved by Manny for some reason. Otherwise his huge ego would not have kept him out of the ring for this fight.
Like they say, "When you hear hoofbeats, expect horses, not zebras."