Holding hands during the Our Father has become commonplace, but it is an illicit addition to the Liturgy. Clarifications and Interpretations of the GIRM ["Notitiae" Vol. XI (1975) p. 226] explains:". . .holding hands is a sign of intimacy and not reconciliation, and as such disrupts the flow of the Sacramental signs in the Mass which leads to the Sacramental sign of intimacy with Christ and our neighbor, Holy Communion."
(see link on comment #5)
I've found a simple way to deal with the hand holding. I hold my rosary in my hands, clasp them together in a prayerful way, bow my head and close my eyes during the Our Father. It's amazing how effective that is....