"I have on occasion." He knows the truth of the matter it's usually with a companion.

"Yaz and I had ice cream while we looked at the Earth." He misses Yaz and upset at his last face about being forward why The Doctor and Yaz couldn't be anything more. Same excuse he used to himself about Rose.