Possible to permanently get rid of mice in NYC apartment?

I live in a 3rd floor apartment in LES with a roommate. Found mice in early Dec and been working on getting rid of them (no crumbs on the floor, no food out, super tried to seal every hole they could find), but haven't gone more than a few days without finding new turds. Just plugged in some high frequency devices and got mint spray so gonna try that too. I think the mice came because they were doing construction in the unit over, and that is done by now.

I really like my apartment but my landlord is okay with us breaking the lease in a couple months, and I already agreed to it, but-

How likely is it that I could effectively prevent mice permanently so I could stay? I really like the apartment but it's probably not worth the risk that they return, especially if they "seem to be gone" in the summer but I'm surprised again in the winter..and I would need to find a new roommate who probably wouldn't be interested in a recently mice-infested home I guess.