My main concern in this scenario is that lenders assess loans above 80% as a higher risk. In most cases this isn't a problem but for a loan over about $800k it can get to the point where it's seen as too risky for many lenders.
Credit unions generally tend to be more conservative. Depending...