If the branches are hanging over their side and they know they are an ussue and they choose to do nothing about it I don't see how they can claim it's your fault. They have been neglectful in not remedying the situation which was in their control.
If the whole tree falls down- different story...