how could you live with a guy like this? You are not responsible unless you intentionally caused the damage. He can not hold you leaving. Even you'll be working together in future, paying this would be ridiculous. Don't worry, there are bad apples on every tree.