Painting your house is going a bit far, but the time to object was when the action was taking place.
People have many reasons to sell, and quiet sales are far from uncommon.
It would appear you both are playing games and dancing around the issue.
Next time you see him, why not simply...