"my boss is not qualified for his job?" is not for you to make this statement. Your boss's qualification is judged by his boss.
It is hard to fight back, and the best is for you to leave. Find another job as soon as possible.
It is much easier to find a replacement for you, than to find a replacement for your boss. Therefore, your company will be on your boss side (HR, one-over-one boss, etc.).