It's ok. When I first watched LOTR, it was difficult keeping Merry and Pippin straight in my head. Not because I wasn't aquatinted with their characters, but because what they looked like in my head was different from what was on the screen. So don't feel bad.