You agreed to pay them X amount for doing a certain job by signing an agency agreement (contract). You don't have the right to pay them less, just as they don't have the right to ask for more than agreed.
It's poor form to ask them to cut their fee but under certain circumstances they may...
