you should do this before you leave US

the E2 is controled in oversea to issue VISA, what you got inside of US is only a one time status change. once you left US, you have to have a E2 VISA for entry and the VISA only can get from oversea.
You can stay in Taiwan and prepare all doc to apply again.