Agree. Keep the record that you sent back their deposit.

And send them an official letter to inform that you cannot rent the house to them because you have other use of the place. I do believe you will have less trouble not letting them in than they do not pay the rent and you have to evacuate them. (If they are willing to pay for a lawyer for an apartment not even occupied, think about how difficult it will be to throw them out.)