It's clearly more a management failure

He is just using you to cover his management failure.

If I were his boss, I'd fire him instead of you. Manager can be succeed only if those work under him/her can succeed.
If he keeping hiring and firing people, he will be tosted sooner or later, believe me.

so do not feel bad, it is NOT your failure, it's clearly the manager's failure