I don't really know the Sydney market, but from my bits of reading here and there, it sounds like it's far from top of the market. If the numbers stack up and you're in a comfortable position I'd say go for it.
I was really nervous buying my first IP a year ago. I had a PPOR and wondered...