i would imagine "the general public" and "money owed for services rendered" is a bad mix in any profession - so yes, i reckon it would be like being a taxi driver.
Yes, there are safety issues with driving buses, such as rock throwers on some routes at night. But generally I'd say that bus driving is safer, more secure with better employment conditions than taxis.
Bus fares are a small standard amount that is paid before the commencement of the trip. Many passengers have prepaid tickets.
A taxi fare is a large non-standard amount that is paid after the trip (exceptions apply at night).
If someone does a runner from your taxi you don't get paid.
If someone tries boarding your bus without paying you do whatever required to put your and other passengers safety first. And you still get paid even if someone evades a fare.
When driving a taxi you're on your own. On a bus there's usually other passengers.
So overall buses would be better than taxis, and maybe this explains why there seem to be more long-term bus drivers than taxi drivers (who are often students or immigrants doing the work until they can get a better job).