If the offset account is on an IP or a PPOR loan there won't be a problem.
But if it is on a PPOR removing money will result in the interest you are being charged increasing and since the loan relates to a non deductible loan the interest will not be deductible.
If it is an invesment and...