I think you should stop communicating with the agent, go straight to the other party's solicitor via your solicitor. The agent is just trying to save their commission and shouldn't be giving you advice on this.
Don';t know about in VIC, but in NSW agents are prohibited from filling in the contract - except for the small box on the front page with names, addresses etc.
