The real challenge is when you decide to sell the property down the road.You have to disclose all the information you've known. The fail of Phase1 test is going to scare away a lot buyers. Then you may not be able to get market price.
There are so many properties out there to buy with same or better potential and less risk, why bother?