That's definitely not an offset and will probably create serious problems with the ATO as Rolf suggests.
I'm guessing your 'refunded amount' could almost be considered income, which you'll have to pay tax on, instead of savings interest, you're earning it.
The reverting rate is about 0.5%...