The last thing that you'd want to do is make the place more attractive to a tenant than the next place. Why would you want a competitive advantage??
Remember, not only are you getting the tax deduction for the interest but you are also getting the depreciation benefit as well.