I had the same experience at a small company. My previous famele boss is exactly like yours and the other coworker kept kicking me under the table.
I was miserable everyday.
I don't think endurance can help you gain experiences. Leave as earlier as you can.