As long as the POA is validly drafted and executed etc it will legally be effective. But the evil brother could allege the attorney is breaching duties, there was undue influence etc and this could start causing problems. He may then apply to the courts to have the attorney removed and a new one...