here is the key point: 如果你老板已經有想讓你走的企圖，

Are you absolutely sure this is his intention? It may be your own insecurity and reflect onto the situation. Talk with your boss first to understand his intention better. He may just need to balance your power with A so that neither of you would surpass him.