Obviously, he is misleading you.
In CA, even the house is separate property, but the intereste will be split if the cost is comingled with community property. If the paid-off money came from your marriage imcome, saying 80%, then you should have half of the 80%
if you really want this share, hire an attorney for yourself, and join the mediation
