Another way to word it that is less challenging is: "What makes you ask?" or " Why do you ask?" It has the same effect. After you have asked it a couple of times, they stop asking because you stopped being an easy source of information.