As far as I'm aware, it's not your neighbour's responsibility. Anything on your side of the fence is allowed to be pruned by you, whether the tree is on your land or not. If you have to access their land (i.e. to climb the tree) that's another story.
If the branches really pose a saftey...