Even if I agreed with this (and I don't), you still have a lot of other Biblical examples which indicate that neither Peter nor the other early Church leaders recognized Peter's supposed preeminence.
But you see this is the evil heart of the Protestant heresy: to bring accusation against the gentle and mild by turning the Scripture into a book of law....giving their inferences from the text the same weight as "thus sayeth the Lord" without any Scriptural licence to do so, and thus taking the name in vain.