I think it's gross income. Here is an article:
http://www.aph.gov.au/library/pubs/rn/2003-04/04rn16.htm
It's a few years old now but you get the idea.
If you want to take into account your IPs you'd have to allow for the rental returns and the tax deductions for the interest payments...
