Some people just worry about that, but nothing happens in reality because no any immigration law limits the green card holder to change job after he/she get the green card.