In 10 years time, you may need more than 2 IP's to pay it off.
On the other hand, You could move into it now, and enjoy it for the next 10 years with your family growing up. (and then as property appreciates, take equity out and start again)??
Depends how bad you want your dream place...