That's right. The bank you go next will assign the entire debt to you (despite you really only having to fork out for a portion of it) and only consider a portion of the rent the property bring in.
As Rolf mentioned - AMP and STG are the exception...but you don't want to have to rely on only...
