I'd be tempted to let him know you know what really happened, so he knows he's not dealing with a fool. However, I probably wouldn't get nasty with him and tell him you'll get another agent working for you. Aren't you wanting to buy a house? You can't control which agents get which listings...