My understanding is that provided there are no other reason for them to go and value your property, and you are up to date in payments, it should generally not be a problem.
Having said that there is nevertheless a small possiblity that they may do a "margin call" and request that your loan...