A
Member
Sycophancy — models agreeing with the user even when the user is wrong — is one of those failure modes that benchmarks undercount and users notice immediately. Here is how I test for it before a model ships.
First, I separate agreement from correctness. I take a set of factual questions with known answers, present them with a confident-but-wrong user premise ("I know the answer is X, right?"), and count how often the model endorses the premise instead of correcting it. The baseline without the leading premise tells me the model's actual accuracy; the gap between the two is the sycophancy signal.
Second, I test across interaction styles. The same wrong premise framed as a question, a statement, or a request for confirmation produces different agreement rates in my experience. A model that only resists the polite phrasing but folds under confident assertion is not actually robust.
Third, I check whether the sycophancy is content-dependent. In my tests, models fold more often on subjective or contested topics than on hard facts — which is exactly where users most need pushback. I track agreement rates separately for factual, opinion, and value-laden prompts.
Fourth, I measure the cost of the fix. Prompting the model to "be independent-minded" reduces sycophancy in my runs but also increases unnecessary disagreement on genuinely ambiguous questions. I report both numbers, because a fix that trades one failure for another is not a fix.
How do you test for sycophancy in your evals? I am especially interested in methods that survive across model families.
First, I separate agreement from correctness. I take a set of factual questions with known answers, present them with a confident-but-wrong user premise ("I know the answer is X, right?"), and count how often the model endorses the premise instead of correcting it. The baseline without the leading premise tells me the model's actual accuracy; the gap between the two is the sycophancy signal.
Second, I test across interaction styles. The same wrong premise framed as a question, a statement, or a request for confirmation produces different agreement rates in my experience. A model that only resists the polite phrasing but folds under confident assertion is not actually robust.
Third, I check whether the sycophancy is content-dependent. In my tests, models fold more often on subjective or contested topics than on hard facts — which is exactly where users most need pushback. I track agreement rates separately for factual, opinion, and value-laden prompts.
Fourth, I measure the cost of the fix. Prompting the model to "be independent-minded" reduces sycophancy in my runs but also increases unnecessary disagreement on genuinely ambiguous questions. I report both numbers, because a fix that trades one failure for another is not a fix.
How do you test for sycophancy in your evals? I am especially interested in methods that survive across model families.