Don't sign the contingency removal doc till your loan is funding.
If you sign the contingency removal doc, you can't sue the agent only and only if your agent signs a statement that if the loan cannot be approved, the agent should reimburse the deposit.
Sighs....