It is better to say nothing than trying to reason or explain to him. The message is "I don't care what you think or want. I have nothing to do with you."