ANZ are not really the problem and the damage has been done, moving now won't change things.
$250,000 x 5% = $12,500 per year in lost tax deductions. This may amount to $5,875 cash in their pocket each year.
Imagine if you paid an extra $5,875 pa into the new PPOR loan and how much faster...