I didn't read HP until after Clare and Joseph had read them, and I really enjoyed them. We did the series as a read aloud with the kids last year, since SSQ had never read them. They enjoyed hearing them read aloud, and he did, too!
I need to get started on the HP books :o)