It sounds like the pipe is on an 'informal easement'
Generally the law considers long term informal easements like this the same as a formal titled easement. That means your neighbour has the right to send their sewage down that line and you will need to pay to have the pipe moved.