Hard to say. It is all what you are accustomed to. I am sure there are lots of Piper Cub pilots who have flown backwards as well. We used to fly our hang gliders backwards all of the time. I have a 1st generation double surface hang glider, a UP Comet, and a second generation Wills Wing Attack Duck. They are more difficult to land than modern double surface hang gliders because the stall speed is 25mph just like the Skypup.
I remember flying one time flying the Attack Duck when the wind was gusting up to 50 mph or so. The lift was terrific so I ended up several thousand feet above the launch area. I inadvertently let myself be blown backwards several miles from the landing area. Fortunately, the Attack Duck was capable of diving up to above 70 mph, but it was still a struggle to get back to the landing area.
The biggest problem I can see with the paragliders that seem to be more popular than hang gliders these days, is that most of them can't go more than 15 or 20 mph. If the wind gets higher than that you cannot make it to your landing area. One of my friends ended up stuck and injured in the top of a tall fir tree for hours. If he hadn't had a good VHF radio, who knows when he would have been found. I flew a paraglider with him a couple of times, but all the swinging back and forth to turn combined with the being lurched up and down by turbulence made me air sick each time.