Your boss is nice.

What he said might be true. The CEO has too much to worry about one of the products. The QA manager didn't have to escalate the incident to the high ups in the company if he really wants to remediate the issue. He was kind of expose himself too. He isn't that smart. You need to help your boss to catch up. He is the one who can protect you from the QA manager.