I struggled with this issue as well, and at the end of the day I had to buy something I would be happy to live in myself.
I am a bit of a soft touch, and definately not hard nosed, so whenever I looked at places that were a bit "rough around the edges" I always felt sorry for whoever had to...