You need to work out what you would pay for the site if it were on the open market. Then make sure you add your project management costs to the price of the house you would build for him.
You will find a bottom line to negotiate with. Obviously he will need to pay you an amount of money to...
