One way to test both situations, if you genuinely want out:
Call the agent back, and tell him that if he has higher offers, you'd be happy to get a no-recourse mutual cancellation of the contract, and see if he'd take it.
If he won't, then start looking at other options to back out...