The issue here is not only who should pay for the clean-up. It's about whether you can get it rented and getting paid while all this mess is going on. What good will it do if they pay for all the repairs in the next two years, but you could not get it rented during this period?
What is you loss if you just back out?