As far as I knew,if you have been waiting for 3 years since you submitted you I-485,It is ok for you to leave once you get GC.