You will reduce your target audience with a house + granny flat down to investors and people with an aged relative or an offspring returning to the nest after a relationship failure.
However, if you are long term buy & holders as you say, then the rental yield from a dual income set-up has to...