Hmmm... I don't have a problem with the wordlview, because I look at it as fiction, a story about a world in which magic can be done by some people who are born with that ability. Clearly, that's not our world. Once you're not in our world, you can postulate what-ifs; what-if magic weren't evil? What-if animals could talk, or trees walk? That's what fiction's for.
And it's not occult, I mean, sure people try to make it that but it's just fantasy. And Rowling is at least nominally Christian and says if we paid attention to that fact we might have some clue where this is going...
Yes, I think you've hit it. Ratzinger rejects this particular fantasy world....probably because it's too close to an occult world.