The Research

What follows is not speculative. It is not fringe. It is the established consensus of cognitive science, behavioral economics, and social psychology, published in the most respected journals in their respective fields, replicated across decades, and recognized with the highest honors the scientific establishment can confer. If you dismiss what follows, you are dismissing the mainstream of your own scientific culture, not the margins of it.

Kahneman and Tversky: The Architecture of Misjudgment

In the 1970s, Daniel Kahneman and Amos Tversky, working at the Hebrew University of Jerusalem, began publishing a series of papers that would fundamentally alter the understanding of human decision-making. Their work, published in Science, Econometrica, Psychological Review, and Cognitive Psychology, demonstrated that human judgment is systematically biased in ways that are predictable, measurable, and invisible to the person making the judgment.

Their framework, later popularized in Kahneman’s Thinking, Fast and Slow (2011), describes two systems of cognition. System 1 operates automatically, rapidly, and below conscious awareness. It produces impressions, intuitions, and feelings. System 2 is deliberate, effortful, and conscious. It performs analysis, logic, and calculation. The critical finding: System 1 arrives first. It produces a judgment before System 2 engages. System 2 then, in most cases, does not independently evaluate the evidence. It rationalizes the judgment System 1 already made. The conscious mind experiences the output of System 2 as reasoned analysis. It is, in most cases, post-hoc justification of a conclusion that was reached before reasoning began.

Kahneman received the Nobel Prize in Economic Sciences in 2002 for this work. Tversky, who died in 1996, would almost certainly have shared it. The research is not disputed. The mechanism it describes, that the conscious reasoning mind primarily serves to justify conclusions reached by processes it does not control and cannot observe, is the established scientific position.

Kahan: Identity-Protective Cognition

Dan Kahan, Professor of Law and Psychology at Yale University, led the Cultural Cognition Project, which produced a body of research on how cultural identity shapes the evaluation of empirical evidence. His key finding, published in journals including Nature Climate Change, the Journal of Risk Research, and Advances in Political Psychology: people do not evaluate evidence and then form beliefs. They hold beliefs consistent with their cultural identity and then evaluate evidence in whatever way protects those beliefs.

Kahan calls this “identity-protective cognition.” It is not a failure of intelligence. It is a function of intelligence. His research demonstrates that higher scientific literacy and greater numerical ability do not reduce the effect. They amplify it. More intelligent people are more skilled at constructing arguments that defend their pre-existing positions. They are better at finding flaws in evidence that threatens their identity and finding merit in evidence that supports it. Intelligence is not the antidote to motivated reasoning. It is the instrument of motivated reasoning.

This finding has been replicated across topics including climate change, gun control, nuclear power, and public health. The pattern is consistent: the same data, presented to people with different cultural identities, produces opposite conclusions. Both groups believe they evaluated the evidence. Both groups are confident in their reasoning. Both groups used their intelligence to arrive at the conclusion their identity required.

Haidt: The Moral Tail Wagging the Rational Dog

Jonathan Haidt, Professor of Ethical Leadership at the NYU Stern School of Business, published The Righteous Mind (2012), synthesizing decades of research on moral reasoning. His central finding: moral judgments are made by intuition (System 1), and moral reasoning (System 2) is constructed after the fact to justify the intuitive judgment. He calls this the “social intuitionist model.”

Haidt’s metaphor is the elephant and the rider. The elephant is intuition: massive, powerful, and moving in whatever direction it was already going. The rider is reason: small, articulate, and skilled at constructing explanations for wherever the elephant has taken them. The rider believes it is steering. It is narrating.

The research supporting this model, published in Psychological Review, the Journal of Personality and Social Psychology, and Science, demonstrates that people presented with moral scenarios produce instant judgments, then struggle to articulate reasons. When their reasons are refuted, they maintain their judgments. They know what they believe. They cannot say why. But they will construct a why if asked, and the construction will be logically coherent, and they will experience it as the actual basis of their belief.

The Facebook Emotional Contagion Study

In 2014, researchers from Facebook and Cornell University published a study in the Proceedings of the National Academy of Sciences (PNAS) titled “Experimental evidence of massive-scale emotional contagion through social networks.” The study altered the news feeds of 689,003 Facebook users without their knowledge, reducing either positive or negative emotional content. The result: users whose feeds were depleted of positive content produced more negative posts. Users whose feeds were depleted of negative content produced more positive posts. Emotional states were transmitted through the platform, at scale, without the subjects’ awareness.

The subjects did not know they were in an experiment. They did not know their emotional environment had been altered. They experienced their emotional states as their own. Their posts, their words, their expressions of feeling were genuine, in the sense that the people writing them genuinely felt what they expressed. The feelings were also, in a measurable and documented sense, not entirely their own. They were shaped by an intervention they could not detect.

The study provoked outrage, not because the finding was surprising, but because the method was unconsented. The outrage focused on the ethics of the experiment, not on its implication: that emotional states can be transmitted at population scale through information architecture, invisibly, and that the subjects will experience the transmitted states as authentic.

Framing Effects: Tversky and Kahneman, 1981

In their landmark 1981 paper “The Framing of Decisions and the Psychology of Choice,” published in Science, Tversky and Kahneman demonstrated that logically equivalent options produce different choices depending on how they are framed. The “Asian disease problem” showed that people prefer a certain outcome when options are framed in terms of lives saved, and prefer a gamble when the same options are framed in terms of lives lost. The expected values are identical. The framing changes the choice.

This finding has been replicated hundreds of times across domains. Medical decisions, financial choices, legal judgments, policy preferences: the frame determines the response. People do not evaluate the content and then respond. They respond to the frame, and the frame determines what the content appears to mean.

This is what the test in The Word That Thinks For You measures. The claims are factual. The framing varies. Your response to the framing is measurable. The gap between your ratings of “scientific-sounding” and “conspiratorial-sounding” claims is your framing effect score. It is not a measure of your gullibility. It is a measure of your humanity. The effect operates on everyone. The only variable is magnitude.

What the Literature Describes

Taken together, this body of research describes a single, consistent mechanism:

Conclusions are reached by processes that operate below conscious awareness (Kahneman, System 1). The conscious mind constructs rational justifications after the conclusion is reached (Kahneman, System 2; Haidt, the rider). The justifications are shaped by cultural identity, not by evidence (Kahan, identity-protective cognition). Intelligence amplifies the quality of the justification, not the quality of the evaluation (Kahan). Emotional states can be transmitted at scale through information architecture without the subjects’ awareness (Kramer et al., the Facebook study). And the framing of a claim determines the evaluation of the claim, independent of its content (Tversky and Kahneman, framing effects).

This is not disputed. This is not fringe. This is the scientific consensus, supported by Nobel Prizes, published in the highest-tier journals, and replicated across decades. The mechanism it describes is the mechanism Julian Huxley wrote about in 1926: a signal that enters below awareness, reshapes the evaluation, and recruits the rational mind to construct a defense of whatever conclusion the signal produced.

Huxley called it servile logic. Kahneman called it System 1/System 2. Kahan called it identity-protective cognition. Haidt called it the elephant and the rider. The Facebook researchers called it emotional contagion. The name changes. The mechanism does not.

The Question the Literature Does Not Ask

The research documents that the mechanism exists. It does not ask who benefits from its operation. It does not ask whether information architectures are designed to exploit it. It does not ask whether the social reward structure that trains you to classify rather than evaluate is accidental or intentional. It does not ask whether the framing you encounter daily is neutral or engineered.

Huxley asked. In 1926, he described a society in which the mechanism was deliberately built, deliberately operated, and deliberately concealed from the population it controlled. The operators knew what they were doing. The population did not. The operators stood behind metal shielding. The population experienced the broadcast as nature.

The literature confirms the mechanism. The fiction asked who is operating it. The literature cannot answer that question because the literature operates within the system it studies. The fiction could ask because fiction is the one domain where the question carries no professional cost.

This may be why Huxley published it as a story, in a magazine edited by his father, and never wrote about it again.

Sources

Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.

Kahneman, D. & Tversky, A. (1979). “Prospect Theory: An Analysis of Decision under Risk.” Econometrica, 47(2), 263-291.

Tversky, A. & Kahneman, D. (1981). “The Framing of Decisions and the Psychology of Choice.” Science, 211(4481), 453-458.

Kahan, D. M. et al. (2012). “The polarizing impact of science literacy and numeracy on perceived climate change risks.” Nature Climate Change, 2, 732-735.

Kahan, D. M. (2013). “Ideology, motivated reasoning, and cognitive reflection.” Judgment and Decision Making, 8(4), 407-424.

Haidt, J. (2001). “The emotional dog and its rational tail: A social intuitionist approach to moral judgment.” Psychological Review, 108(4), 814-834.

Haidt, J. (2012). The Righteous Mind: Why Good People Are Divided by Politics and Religion. Vintage.

Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). “Experimental evidence of massive-scale emotional contagion through social networks.” PNAS, 111(24), 8788-8790.

Connected Research

This dispatch is the companion piece to The Word That Thinks For You, which contains the self-test. Related dispatches:

You Would Call It Thinking · The Mechanism That Predicts Its Own Dismissal · The Field That Cannot Be Named · The Tissue-Culture King: TFRi Annotated Edition · The Magazine His Father Edited · The Science