You quit = you admit you lost. It's a happy ending for people who work against you. And they will laugh at you for going home but not moving onto something better and bigger.
I have seen so many people who quit their job on the spot and took a long time to find another job. Not saying it will happen to you but you do have to prepare for the worst.
Stay strong mentally. You can stop caring and just show up from 9 to 5 since you have nothing to lose. Quitting is absolutely the worst you can do.
If I were you, I'd still try to work out the differences or at least not let it get any worse with your manager until you find your next gig.