Check your mgmt agreement, there may be an assignment clause, perhaps wth your consent perhaps without.
I have in the past simply ordered them to handover the ledger to a new PM regardless of termination notice periods if they have been incompetent. What are they gonna do, sue you over 3 months...