That's correct. If you purchase a holiday house, for your own use, you will pay CGT when you sell. However, the holding costs (rates, interest etc) are added to the cost base, reducing your capital gains.
This is for purchases dated after August 1991