This is true - but you also have to remember that you're under no compulsion to actually spend the money once it's available. If the market does tank/rents fall/interest rates skyrocket, wisdom might dictate that you leave it where it is.
However, if you don't make it available while you...