If you don't refuse within 28 days, it will be automatically released. I think what your conveyancer is suggesting is that you don't have a valid reason for refusing.
Reading S27 of the Sale of Land Act, it would appear to be true that you do have to give a reason for rejecting an early...