Littletee
I think you could build one duplex as Owner Builder in your name, move into one side, then after a period of time, your wife applies for Owner Builder permit and builds a duplex and you then move into one side.
This may not work with your current block but is a way of getting 4...