Unless I'm missing something, and if the only reason he would "lawyer up" and force you to court would be to force you to sell. If you agree to sell, then that is what you and he agree to do.
You can still buy it yourself, and if that doesn't work due to finance and/or job, then you probably...