Just tell them directly :Say it once, it's funny. But I will be

They will respect you, and think that you have a good personality. If you don't say anything, your co-workers will not take you seriously. It's not just personality, they could think that you are not good at your work. Be firm and polite. Good luck.