I agree with this. He HAS damaged walls wilfully. I would involve the police and at least he will know that he has a target on his back and might be more careful if he is planning something else.
Could you let him know you've reported his comments to the police. If they will not visit him, the fact that his plans have been reported to the police might make him revisit that idea.
What a horrible situation. Good luck.
