I think he's dating said lady of the night, as why else would they go to church together? Another thing is "need to tell her she's the only one I really love" implies that they aren't married, so I say he's just dating.
Huge Zeppelin fan, BTW. Yardbirds too. Really, anything Page touches turns to gold.