The ATO might start asking questions if you tick the box that asks something like "have you refinanced or renegotiated your loan...?". In your case this hasn't happened - you've simply drawn down on the offset account - so you've got nothing to worry about.
From what I can recall there's...