Sorry for your bad news. I hope that you could appeal that or refile your case soon.
For your legal status, you don't need to worry about that. Since he never used his EAD, he is still H4. No need to leave this country. The fact that he used that to apply for SSN does not revoke his H4 status.
Best wishes.