Well, at least until you heard "God" for the first time.

Wrong. No baby claims that God doesn't exist. If you want to pull the "absence of belief" card, than every inanimate object would be an atheist, even the waffle fries I'm eating while typing this.

Maybe you just can’t understand the baby’s language.

Actually, you must have felt some connection with the ideal being for he was with you since your creation.