I suggest one of you (who shall be forever after known as the "organiser" :) ) just draw a line in the sand, declare a date and place. (Don't ask "where" - just decide. You can get feedback and modify for next time)
Good thing about being the self-nominated organiser is that you get to decide...