To me the downside is that any one of the 50 owners could be in financial difficulties and has to sell their townhouse in a hurry/firesale. Your townhouse's value is then negatively affected by that sale price.
Of course this can also happen in a six pack or eight pack, but you are reducing...