If it is causing a heap of stress and really impacting your life, then you could always sell.
Saves the possible large fine & you can offload the property to someone who admires the tree, whilst buying a tree free backyard for yourself.
I know there are costs to selling, and buying, but if...