Your problem rest in small openings.

Most rodents that can put there head through an opening can also put
their whole body through... I'm talking about small mice here...not
giraffe, cats, or tiny buffaloes. :-)

What Andrew Neilson said is right... fix the "small hole" problem and
the mice will vanish.

Good luck,
Dave