After I read it again,I feel nothing wrong with him. He broke up with you since you let him wait for so long.
What is your intention in these three years? You never seemed give him the future and his intention / offer expired since you never give him a counter offer.