They shouldn't ask you this question

It can be easily attacked as a racist question for a job interview unless you were interviewed for a cultural reseach position. However, sometimes you cannot be too sensitive if you want to get this job. You don't need to get into details though. I would say what you answered "I don't feel too much difference" should be enough.