True, but the key is you have to be on their "radar" as not making payments, and especially if your borrowings are (as you rightly pointed out) in the millions, with the one lender.
Sorry I should have mention this is part of the balancing of your portfolio, equally as important to the other...