This is not a leagal issue--follow your own heart.
Your boss did not break any law. You won't break any law by giving out your oppinon, or not giving your oppinon, about him. Any one can quit his/her current job and move to a new one. Unless you are working for the FBI-Funny Bussiness Incorperated,:) right?