Not a big deal.

It is very common saying "you are my go to guy/girl". My boss will be happy if I say "you are my go to guy" to him directly. I wouldn't think anyone else would be offended.

If you like her and can work with her in the future, why do you care other person's comment? I would question why the 女同事事後對我說她對我不尊重.