Generally I'd be happy if my side looked good and would ignore that it's a little taller than the fence.
When I build on the boundary I have to have face brick facing my neighbour so that it doesn't need render etc and is attractive.
I'd just ask nicely for them to make it attractive on...
