There certainly are some competitive rates with the smaller lenders, but in many cases they come at the price of flexibility/policy/various other reasons.
As you've mentioned, rate isn't the most important thing. Finance which fits your needs and strategy comes at the forefront of lender...