He can't lose the trump card
He is using IRS to blackmail you. If he went to IRS, he lost his trump card. Just delay him while you consult a tax lawyer. He will go to IRS only if he feels he can't get anything out of you.
That's only my guess. Programmers could lack of sensitivity to people's emotions. Just don't stress too much.