what level of absestos? If its just things like bathroom lining or in the lino i would still consider it and just budget accordingly. Seriously the stuff if left alone is fine it was the wonder material that is water & heat resistant, decently strong and cheap, i think most people would be shocked to find out what level is lurking in so many houses built or renovated while it was flavour of the month.
If you want to reno then yer it will cost more and should be dealt with by profesionals if they are really concerned get a quote on getting it removed. If the numbers still stack up then why not?
