If you decide to go ahead, make sure that the walls are, and 'look' as though they are secured well to the existing structure.
We bricked in our carport with a brick stud wall in 1990 and when we came to sell the place in 2009, the building report came back with the stud wall being a risk...