I wouldn't do it. The DOH may have long term plans to build apartments, villas, aged care etc there.
Aged care would be ok but anything else will devalue your land.
If a developer needs to purchase more than your lot to make it feasible then they would be hesitant to purchase from DOH