It's investment, so who cares what others think.
One of my friends once referred to me as a 'slum-lord', to which I replied "thanks, that block of flats produces the best cash flow of the whole portfolio".
People make excuses like this to make themselves feel better (or at least OK)...