The fact that Ing won't take land as security gives you idea of their appetite for construction. Avoid IMO.
If servicing is an issue have you considered using future rental incomes on both townhouses in your calcs? Would be accepted even if selling one.