If you work in NY State, you have to pay NY State tax even if you live in NJ. In tax season, you need to fill NY non-resident tax form and NJ resident tax form. If you were withheld New York City tax, you may get a tax refund from your NY non-resident tax return.