You are talking about three types of costs.
1) The actual building expenses - many of the reno expenses will not be deductible because they are of a capital nature. They may be depreciated when the house is available for rent.
2) The interest on the money borrowed to pay the above expenses...