Mice will leave if there is no food for them to eat

Put your food inside sealed containers.
Food is one of the things mice came to your house.

Rats need a continuous source of food.
If there is no food source then the rats will move on.

Every single garbage can must be tightly covered with lid.