Raphael,
You may want to explore the following idea further with lawyer/accountant as I'm not sure about all the practicalities.
1. Get a couple of independent valuations done and agree on a value with your brother based on these valuations.
2. If you can afford 50% of that then buy your...