well, even if you look at the space between them, you're still looking at stars that are millions or billions of light years away that are simply too dim/far away to be seen or are blocked out by the atmosphere, so they aren't visible but you technically are looking at them nevertheless
(🤓, i know)