I agree with Aaron. Do both.
Pay down the loan by $50k, then borrow that $50k again. It may sound silly, but interest on borrowed money is deductible if used for investing...
So you would have generated an extra $2500 per year in deductions ($50k x 5%). but still be paying the same...