Many years ago we were in this same situation, our resolution was:
Put the deposit on the block of land
Obtained permission from the vendor to build on it
Spent our weekends as owner builders building our own house
We paid for each bit by cash, saved up and paid for the slab
Saved up and...