Those things are worth money. You should have sold them!
The problem, which I have learnt from my previous neighbours, is that you give them an inch and they take a mile. You just need to give a polite but firm "no" to requests from the outset.
Maybe rent your IP to a corporate tenant such...