Make sure to set the handle latch back when you shut the door every time. I have the same problem on my old car Accord 96'.