I would say do it. A bit of sacrifice now for future reward. Isn't that what investing is about too. Capital growth is not guaranteed, but yet, we sacrifice a bit of our lifestyle now in hope that in the future, our asset base has grown.
You may also be able to negotiate with your employer...