If you can make your way to Coffs, then why not a bit further north?
Lots of towns / villages to explore within relatively close proximity (the following are all within 1 hour of Byron Bay) - Evans Head, Lennox Head, Ballina, Brunswick Heads, Mullumbimby, Lismore, Nimbin, Alstonville, Bangalow, Mullumbimby, Pottsville, Kingscliff, Coraki (and numerous smaller ones).
Minyon Falls
Mt Warning (climb before dawn to watch the sunrise)
Lots of good surf breaks and other water sports
Arguably the best beaches in Australia
Good fishing in the estuaries or off the beaches
Golf courses pretty much everywhere (Ballina, Byron, Lismore, (Royal) Teven, Woodburn-Evans Head, Coraki, Mullumbimby, Ocean Shores)