I think it depends on
1) your available capital (there is no point giving up your day job, if your capital will return less than the day job)
2) the attractiveness of the passive asset class to produce above the mean returns in the medium term.
I started with one small business in 1998...