Not that TD is respected more, but TD is in NYC. At least you have a better location.
You have more time to social and interview while in NYC for next job.
Plus, the Wall Street head hunters are mostly NYC based.
Charlotte is a major financial center, but mostly for back office or mid-office jobs.
Once in Charlotte, you might be stuck in Charlotte.