You would need to charge the trust at least what you are paying in interest, if not more. You should have a written loan agreement which would hold up in court.
However when you say 'friends' this may mean you have a unit trust. You should seek tax advice before getting legal advice as you...