Unless you want to be public enemy
Everyone wants to have an easy life. Managing the output of the group is your manager's job, not your job. Your boss could also be lazy and does not want the trouble of managing the remote group closely.
If you want an excellent performance review, you can discuss your contribution without comparing yourself to others. Your boss said he wanted to give others a chance. That's a hint that he does not care about performance as much as getting people happy. So why should you upset everyone and make yourself a public enemy?
If I were you, I would spend more time developing myself. Count your blessing that you have an unusually easy job.