I think you used is Jap's J1.

In your visa, do they mark "2 years home service required"? If not, maybe you don't need waive. If yes, try Chinese embrassy firstly since I don't think you can get any letter from Jap.