Yes,if the immigration officer find out the fact

Usually if you stop working for your h1b employer more than one month,your H1b would be considered to abanon.If your gap more than six months,you will lose
the qualification to adjust status within USA,except you apply green card base on a marriage with your US
citizen spouse.