There is more to a CBD than just offices. People live in places because of the lifestyle, which includes access to food and entertainment, as well as proximity to work.
This is my opinion, but if you want to live in the CBD, why would you live in a place which is not the CBD? It is this thought...