It does depend on the individual circumstances and goals, but the parameters Rolf has outlined tends to fit fairly well to most scenarios from the perspective of lender policy.
If your serviceability is somewhat limited, then it may be necessary to diversify sooner.