Actually, over time I've had some pretty good luck all in all.
In general, I can empathize with those faithful laity who had the bad luck of living in a diocese run by an Arian bishop. Must not have been terribly pleasant for them either.
And there are any number of other examples. For example, to be a faithful Catholic in England during the 16th Century, particularly after one's bishop just burned a pinch of incense at the altar of King Henry. It would have been so much easier to follow the Church of Cromwell.
The Holy Spirit runs this show, not me. He will correct matters. Hopefully sometime during my life, but if not, it's still my job to stay faithful.
One of my favorite quotes from St. Athansius:
"May God console you! ... What saddens you ... is the fact that others have occupied the churches by violence, while during this time you are on the outside. It is a fact that they have the premises – but you have the Apostolic Faith. They can occupy our churches, but they are outside the true Faith. You remain outside the places of worship, but the Faith dwells within you. Let us consider: what is more important, the place or the Faith? The true Faith, obviously. Who has lost and who has won in the struggle – the one who keeps the premises or the one who keeps the Faith? True, the premises are good when the Apostolic Faith is preached there; they are holy if everything takes place there in a holy way ... "You are the ones who are happy; you who remain within the Church by your Faith, who hold firmly to the foundations of the Faith which has come down to you from Apostolic Tradition. And if an execrable jealousy has tried to shake it on a number of occasions, it has not succeeded. They are the ones who have broken away from it in the present crisis. No one, ever, will prevail against your Faith, beloved Brothers. And we believe that God will give us our churches back some day. "Thus, the more violently they try to occupy the places of worship, the more they separate themselves from the Church. They claim that they represent the Church; but in reality, they are the ones who are expelling themselves from it and going astray.Even if Catholics faithful to Tradition are reduced to a handful, they are the ones who are the true Church of Jesus Christ."
It seems to me that there were probably a number of Catholics who did not attend mass during the Arian heresy. It's not like they could hop in a car and drive to another parish.