Being a duplex development, side setbacks most likely will be right of way for services.. (meaning trade will have acess to side in worst case sitiation)
Plus, For that look, OP will have to construct boundary wall (engineered approved) + render + paint.. it will start to add up.