Probably whatever language they learned to read. Just as we assign sounds to individual letters, so do they. They just don't hear the sounds made.
Or perhaps it's the equivalent of thinking in pictograms, where individual thoughts represent certain concepts, just as certain symbols represent certain concepts in pictogram writing.