If you can find where they are coming in you could break the trail, they need to get back to the nest to eat. Look outside somewhere and smash the tunnels, should work.
If you make holes in where they are working they will repair those holes rather than eating more good stuff too, I think, but...