Yes, no and maybe.
If you are buying a going concern being registered can save you 10% compared to not registered.
If you're registered you offset the gst collected against gst paid.
You can't pass on gst if unregistered (makes your rent look higher compared to comparable premises).
Depending upon the value of the property & rent value you need to bite the bullet.