You are a gold mine to the agent
The agent make $$$ on the loan fees. You are paying the fees everytime you refinance. I guess you did not pay down the principle dramatically, so your principle will getting fatter and fatter.
In summery your agent is bleeding you alive.