In my opinion yes it's a waste putting a duplex on it. Instead of 3-4 bedroom duplex in the rear you could have a nice 2 storey building with 2 of 3 bed, 2bath apartments.
A staged development would keep holding costs as low as possible. Rent from the front house can help with the...