I've seen quite a few changes in Govt and Ministers.
In all cases, the advisors have changed with the Minister.
The Departmental Liaison officers, who are public servants, often stay. These are liaison officers - they arent providing advice on policy.