This is why "deemed rental" income tax can be a good idea, to minimise this problem.
Owners are taxed on a rental income on a property whether they receive it or not, to reduce the incentive to leave it empty. Many European countries have this approach (e.g Spain, Switzerland).