One thing u do need to be aware of is that once you turn your place into a PPOR, the existing and remnant debt needs to be correctly structured.
A question........ have you ever salary credited any of the loans or used redraw from the loans.
Pls dont take tax advice from a bank or broker...