You're entitled to position a new fence on the correct boundary, but I believe that in the absence of any other problem with the fence, other than its location, you'll have to wear the entire cost.
The legislation says - broadly - that if a dividing fence isn't on the boundary, then for the...