Most of these are really studios and not granny flats, and shouldn't be separately tenanted. Council seem to give a blind eye especially if owner lives in the main house and rents out the studio. Note if your neighbor complains, council have to investigate. Further spending on fencing etc might...