According to US Immigration law, you will need to leave the country immediately. You might have a 10-day grace period, but that's about it.
May people choose not to leave. If are able to find a different job within a reasonably short period of time, you might be OK. But there is always a risk if the previous company sends a termination notice to INS.