Common man, it's the opposite!
As the AUD rises money abroad loses value.
No, you are confused. If you borrow 1 million AUD under 2 different exchange rates:
1. If AUD/USD was 0.50 - this equals to you borrowing US$500,000. On 5% interest rates that is US$25,000 per year, which is A$50,000 per year.
If the AUD/USD then went up to 1.00 then you would be still be paying US$25,000 per year, but because of the exchange rate you only need to fork out A$25,000. So it is better for you.
2. If AUD/USD was 1.00 - this equals to you borrowing US$1,000,000. On 5% interest rates that is US$50,000 per year, which is A$50,000 per year.
If the AUD/USD then went down to 0.50 then you would still be paying US$50,000 per year, but because of the exchange rate you now need to pay A$100,000 per year, double what it was before. This amplified even more if it is a P&I loan because the principal has also gone up.