The word weeb is derived from the word weaboo, which is a slang version of Wapanese, or, wanna-be-Japanese. True weaboos deny their own culture, and glorify and fetishize Japanese culture. Being an Anime fan does not make you a weaboo.
TL;DR: The word weeb does not mean anime fan.