I wouldn't close it up. I like it.
Can you just leave it as it is? I don't think it is ugly at all, but perhaps if you don't want tenants lighting open fires, buy a firebox insert?
If you really think it is ugly, make it prettier. Check our Houzz or other design sites for inspiration.