I wouldn't be covering any of the tenants expenses if I had the choice.
The expenses you pay may become tax deductible but in effect you'd really only be getting back a certain % of the payments (whatever your marginal tax rate is). $1 in the hand is better than 15c, 30c, 37c or 45c.