I think you (and others) have talked yourself into it.
But as only one other poster has mentioned, never underestimate the satisfaction and pleasure derived from doing well in a great job, and the rewards, financial and otherwise, you and husband can enjoy from your current employment.
I...