Why not just leave it alone without closing it? An expert who always does the TV show about personal finance suggests that in such a circumstance, you'd better just cut the credit card in half and throw it away but not closing its account.
YOu are welcome.