"I'll admit my time seems to have been more pleasant than yours since we last spoke."

He says it, at least, with a look that might be considered sympathetic. It's the only fact that he likes Mat that keeps it somewhat sincere rather than simply a pleasantry.