I would suggest from a buyers perspective, it possibly does. I think it can have a negative connotation in a lot of buyers minds, who either want brick for it's sturdiness or timber/weatherboards for aesthetics/character. Aluminium doesn't really work for either of those things (unless you're in Broome) and can look pretty shed-like and cheap.
That said, in an estate full of them around it might not make a huge difference in terms of value.