This reminds of that joke: "What do your parents and your kids have in common? They both hate you."
But seriously, I think I began to develop increased self-esteem when I stopped caring so much what others thought of me. Not to the point where I was narcissistic and self-absorbed, but I think...