Oh, he said it alright, in 1996. In a book someone published then. Literally the first time anybody had ever heard of it ever as all parties that were with him on Air Force One in 1963 when he supposedly said it were long gone.
Other than that book in 1996, the quote never existed.
The quote in the meme, however, that's totally verifiable.