Leave him and make me your plaything.
Just joking.
My take is this - and I'm one of the oldest and made the most mistakes on this site....
1. Pay off any debt when you can. It's all good.
2. However; further to point 1 - pay off any non-deductible debt first, and pay off the highest interest...