Sure, without being indignant or petty, make the neighbour aware that he is using your airspace.
Best not to make a big fuss over something so small. Who knows, you may someday need to buy-out your neighbour and it helps to get him on-side.
Sort it out over golf and beers, I say. I...