The fact of the matter is you're wrong. It can be used in the context you think is wrong. But you probably only read the first two usage examples on dictionary.com and neglected the next five or so.
You are certainly free to disagree, but I am not alone in my belief, nor will I ever stop hating hearing people use regards incorrectly:
https://brians.wsu.edu/2016/05/24/in-regards-to/
https://www.quickanddirtytips.com/education/grammar/regard-versus-regards
https://writingexplained.org/in-regard-to-vs-in-regards-to
http://www.bbc.co.uk/worldservice/learningenglish/grammar/learnit/learnitv35.shtml
https://english.stackexchange.com/questions/360567/which-is-the-correct-usage-with-regard-to-with-regards-to-or-in-regard-to-in
https://www.btb.termiumplus.gc.ca/tpv2guides/guides/wrtps/index-eng.html?lang=eng&lettr=indx_catlog_a&page=9K1bOMmCKqYI.html
http://www.dictionary.com/browse/in--regard--to
So you can, https://www.youtube.com/watch?v=rD9rQrbU-HM
Well, maybe we can agree on something else--I hate how peoples' linguistics have eroded so greatly, that instead of saying, "speaking of..." they now say, "talking about...", which just sounds uneducated to me.
Caption this Meme
