I think you're over complicating what is a pretty straight forward thing.
Get a good broker, get a good builder, get a construction loan, appoint an independent inspector to come it at each progress payment stage and most of the issues you've mentioned that have made you consider this...