A retaining wall is not considered to be part of a boundary frnce unless the actual fence is attached to it - which from your post, this one is.
Therefore, it is up to you and the neighbour to go 50-50 in repairs or replacement as per the 'dividing fences act' in your state. You need to start...