If you did, the broker would be getting his cut so there will be less room for the bank to move.
In cases where you want to get the max discount possible you've got to be dealing with the lender direct and to have all of your loans taken directly with them and not through a broker.
I...