Sounds like a deadwood covenant and it is likely that some of your neighbours may already have had theirs removed at one stage or another.
There are 3 process that you are able to remove or vary the covenant, the simplest is the planning permit process through Council. As a few others...