Agreed.
Do your DD but asbestos doesn't need to be a deal breaker. We just had the sheets removed from bathroom and laundry in PPOR and it was only around $2k (and this is in canberra which seems to be the most expensive place in Australia at times).
Cheers
Jamie