Maybe tell your big boss

you are more than willing to improve while keeping the good work but the lowest score will be misleading, and it's hard to explain how come a long time good employer suddenly became the worst which is not entirely true...

of course you can try to put the above words in a nicer way...