You should give money to the lawyer. This is true since your case took his some time.
Talking with lawyer is also expensive. ~$1000 per hour. A lawyer has several employees and they also need to be paid.
You already signed the contract and you should pay according to exactly what is stated on the contract.