Correct. In reality, if it is a private rear yard and no neighbours can see it then it is unlikely Council will get wind of the addition. There are many non-permitted property extensions that stand the test of time.
BUT, being a prudent and well informed purchaser I would not touch it unless...