I also back onto a reserve, but fortunately in a very low-crime area, so haven't had any issues.
But my first thought is this: is the fence see-through, like a chain wire fence, or solid, like timber or brick? If it's solid, it could be that the fence actually detracts from the security...