No, it really is. Sorry.
Look, words can change their meanings very subtly every time you use them - and this is common for words that have become political pejoratives e.g. what the hell is a socialist anyway?
But regardless, you have to make your peace with the fact that there is a use of the word that is generally understood by most people across society - and it can get very specific. So yes, you can be racist to Muslims. Most dictionary definitions adapt to this accordingly.