How do I let him down easy?

[ⓢⓤⓕⓕⓘⓒⓔ]

If he is saying stuff like this.
He will most likely try to get back with you hence the "trying to make you jealous".
If you have a friend available at the time of the phone call it would be best for emotional support.
Someone who knows it was for the best.