Very hard to drill through concrete or brick without damaging the other side to which you drill.
I'd be looking for a flange to cover the damaged area , same colour as the
ducting cover to make it look like part of the installation so no painting required.