As a fellow white person, this has literally never been an issue. Nobody is attacking you for being white, having white friends, or speaking English.
(You should try to learn a second language since it can be helpful when applying for a job and it's also a great way to improve your memory and brain function)