I think you need to take time to calm down and decide what you think you will achieve by court action. If you feel physically threatened then it may be worth considering. If you just want a type of moral victory over this person then you are on shaky ground.
AVOs are given in an attempt to prevent violence, and there is little evidence of this in your posts. If he has been physically violent (towards YOU, not anyone else) then you will need good evidence that will stand up in court, probably police reports and medical evidence of injuries.
Once you instigate court action, you can be held liable for costs. As the other person (or his spouse) owns a unit in the complex, this will make your task more difficult as this person has good reason to be on the premises. Many married couples put assets in a single name for various reasons but are still considered assets of both.
The fact that in the first place you broke the by-laws and this person had cause to remonstrate with you will also be a factor.
Should you choose to go to court, you must consider the possibility that you may lose, which could turn a difficult situation into an impossible one.
I think the previous advice to simply ignore this person, obey the by laws and defuse the situation is worth serious consideration.
And yes, I know of people who have been awarded AVOs and it is not an easy process and required significant actual evidence.
Marg