Assuming the wedding is a week away, I would call him this morning, remind him that he told "father figure" (which was basically giving him permission to hit you) and tell him you cannot be in his wedding.
Of course, if you fear for your safety, then go ahead and be best man and then quietly...