Your are right. Ask him to lay off you might be a better option.

Unless you can find a job in 2-3 weeks, then quit.
Or you can quit and say you have enrolled in some program to improve your skills.
Anyway, just be open and negotiate. There is nothing wrong with bargaining.