Ok here's a possible plan going forward.
1. Make sure your loans are Interest Only with 100% offset accounts.
2. Buy a PPOR in your name. Have your brother move in with you and turn his PPOR into an IP. Presuming his loan has an offset account redraw it to put against your non-deductible...