Yes definitely keep insurance, even if you switch to building only and use a pay by the month insurer and then cancel it when you are done.
It will be a requirement of the mortgage that the property is insured for a minimum value specified by the lender.
Consider the scenario where tenants...