I'm not keen on saying who was worst, but although Whitlam was only in for 3 years there is still a lot that we got from that era:
Trade Practices Act, Family Law Act, Medibank now Medicare to name a few. As GeoffW mentioned free university was another major structural change in our society.