Only pay 10% to the agent now and any additional funds you wish to contribute should be paid at settlement.
Even though I a big believer in paying LMI when you can but in this case I would borrow 80% on interest only and put the rest in offset account as suggested.
good luck