TBH, I'm fine with just being a LOTR nerd. Suits me more. It's where I get my username from. And from what I've heard, Hairy Potter really isn't that worth it. All of its good traits are taken straight out of LOTR and Chronicles of Narnia, and the rest is either moral garbage or just plain not worth it. Granted, I'm a Christian, so maybe that's where my main objection comes from. But still, there is empirical evidence that J. R. R. Tolkien's works are far superior to HP, not only in Christian morality, but also in writing style and in terms of the stories that they respectively contain.
But if you want to stick with your world of wizarding, where there is no real purpose for the characters' existence except to destroy Voldemort, that's fine. I'll stay with my world of elves and dwarves and hobbits, where each character plays a crucial part in the downfall of Sauron and the return of the King, and the story within is a tale of despair turned to hope, captivity turned to redemption, pain turned to healing, and in which we can learn that, even though the fight against evil isn't over yet, we have hope that all will be well again.
I'm sorry if my response sounds a bit snarky. I tried to be as polite as possible, but sometimes my passion gets the better of me. I hope you are having a great day, and stay safe!