He'd be a very dumb RE if he did as you are suspicious already...you could drop a note in the tenants letterbox asking them to call you please just to verify something maybe...only a suggestion as to how to find out.
The other thing is that he is totally telling the truth and you have nothing...