I would do the old Kerry Packer thing.
Prepare a contract in advance - He makes what he thinks is a fair and reasonable offer for you to buy him out.
If you don't accept, then he must buy your half at the same offer price.
Fair for everyone.
If he thinks it is valued higher, he should pay...