Stick to your guns and ask your agent (is he/she 老外?)write a letter to explain the high cost to fix the house ... this is what I did and I got a house (SS) at a price almost 20% lower than another similar house on the same street.
The worst thing that can happen to you is that the bank says no and you move on.