Bless you sir.
I mean that too. Not the annoyance part, but the blessing part. :)
"Finally, one cannot consider as schismatics those who refuse to obey the Roman Pontiff because they would hold his person suspect or, because of widespread rumors, doubtfully elected (as happened after the election of Urban VI), or who would resist him as a civil authority and not as pastor of the Church."
(Wernz-Vidal, Ius Canonicum [Rome: Gregorian University, 1937], Vol. VII, p.