If any negative feedback on you, you should have the right to know.
Suggest ion:
1. Talk to HR about the feedback.
2. Talk to the referee, ask about his expectation on you.