Not impossible, but they could ask to reduce LVRs...on IPs too...
I know once a bank asked us to repay the whole LOC... It wasn't a nice feeling, but mainly it was used for business (it was a small amount too!).
So they can do anything they like, right?