My guess - it's bothering you because not telling him how he knows you is, technically, a lie of omission. It bothers you because you're an honest person.
However, you probably also recognize that opening that can of worms will most likely lead to more drama than is called for in this situation - so the omission is warranted, imho. You don't owe everyone you meet an explanation, especially i
Forum:
Recovery Board