Better to use the $5m for higher yielding investments and then use the cashflow to pay down loans. Same for charitable donations (use the cashflow not the capital).
Personally, I'm surprised at the number of people who'd still be looking at residential property investments.