you remind him of his father.
If you have in your mind "what the father would have done?" he can sense that.
If you are acting like his father's shadow, that's worse.
Forget about the father. The son is your boss. All your words and actions should have that in mind. He owns the place. You don't.
"雖然能力不如他爸", don't even think about it. You shouldn't care.