How Groups Can Catch Bad Intuition

Introduction

When fast intuition needs a second pass, groups face a special problem: a room full of intelligent people can still reach poor conclusions. The issue is not only bias—systematic errors that push judgments in one direction—but also noise, the unwanted variation that causes different people, or even the same person at different times, to make inconsistent judgments. Research on decision hygiene argues that many group failures arise from process design rather than a lack of intelligence or integrity. Groups often improve their decisions not by trying harder to be objective, but by structuring how judgments are formed, compared, and combined. conversableeconomist.com+2Issues in Science and Technology[conversableeconomist.com]conversableeconomist.cominterview with daniel kahneman noise and decision makingInterview with Daniel Kahneman: Noise and Decision-Making15 Apr 2022 — The structured interview breaks up the problems into dimensions, g…

Decision hygiene refers to procedural safeguards that reduce both bias and noise. Common examples include independent assessments before discussion, explicit scoring criteria, delayed overall judgments, and the aggregation of multiple viewpoints. These methods are especially valuable in hiring, project selection, funding decisions, performance reviews, and major family choices where intuition is useful but should not be allowed to dominate unchecked.[Behavioral Scientist+2William Meller]behavioralscientist.orga conversation with daniel kahneman about noiseIt's not only noise reducing, but if you have an…Read more…

Bias Versus Noise in Judgment

Many people understand bias. If a hiring committee consistently favours candidates from a particular background, the error has a direction. Noise is different. It appears when equally qualified candidates receive very different evaluations from different interviewers, or when a project proposal receives dramatically different scores depending on who reviews it and when. Noise is often less visible than bias because inconsistency can look like normal disagreement.[The Uncertainty Project+2Jury Analyst]theuncertaintyproject.orgThey use an archery analogy to illustrate the difference.Read moreThe Uncertainty ProjectApplying Decision Hygiene to yield better judgment12 Apr 2024 — The authors establish that good judgment can be ha…

This distinction matters because eliminating bias does not automatically eliminate noise. A group can be unbiased on average yet still make unreliable decisions because individual judgments vary unpredictably. Kahneman, Olivier Sibony, and Cass Sunstein argue that organisations frequently focus on fairness and prejudice while overlooking the equally important problem of inconsistent judgment. Issues in Science and Technology+2The Uncertainty Project[issues.org]issues.orgIssues in Science and TechnologyInterview with Daniel KahnemanThe Nobel Prize-winning psychologist discusses the “noise” that besets huma…

The practical consequence is that two committees using identical information may reach different conclusions simply because members interpret evidence differently, emphasise different criteria, or are influenced by the order in which information appears. Decision hygiene seeks to reduce this variation by making judgment processes more consistent.[scholarworks.bgsu.edu+2Wiley Online Library]scholarworks.bgsu.eduSome assert that noise (i.e., unwanted variance) is the most neglected yet most important source of error in judgment.Read more…

Why Discussion Can Corrupt Good Judgments

Most groups assume discussion should begin immediately. Yet one of the strongest findings in decision-hygiene research is that early discussion often contaminates information.

When people exchange views before recording independent judgments, several effects can occur:

• Early speakers anchor the conversation.
• Senior or confident members gain disproportionate influence.
• Members suppress minority opinions.
• New information becomes filtered through emerging group narratives.
• Independent evidence is lost because participants converge too quickly.[Barron's+2The Decision Lab]barrons.comBarron's Daniel Kahneman Says Noise Is Wrecking Your JudgmentHere's Why, and What to Do About It.March 28, 2024 — Daniel Kahneman, a renowned psychologist and behavioral economist, explored the conc…

Kahneman has argued that meetings work best when participants arrive with pre-formed individual judgments. Discussion should compare those judgments rather than create them from scratch. Otherwise, the group risks replacing multiple independent signals with a single socially constructed opinion.[Barron's]barrons.comBarron's Daniel Kahneman Says Noise Is Wrecking Your JudgmentHere's Why, and What to Do About It.March 28, 2024 — Daniel Kahneman, a renowned psychologist and behavioral economist, explored the conc…

Research on collective decision-making supports this concern. Diverse groups can outperform individuals when they contribute genuinely independent perspectives. However, the benefits of diversity shrink when social influence causes rapid convergence before all information has been surfaced.[PMC]pmc.ncbi.nlm.nih.govPMCMaking better decisions in groupsNIHby D Bang · 2017 · Cited by 256 — We highlight the advantages of group decision-making in overcoming biases and searching the hy…

Independent Assessments Before Discussion

A core decision-hygiene principle is simple: judge first, discuss second.

Instead of opening with debate, each participant evaluates options independently. Scores, rankings, forecasts, or written assessments are collected before anyone sees other people’s views. Only then does discussion begin.

This approach produces several benefits:

1. Improves aggregation. Multiple independent judgments often outperform a single consensus judgment. Barron’s+2William Meller

The principle appears in many high-stakes settings. Investment committees often collect forecasts before meetings. Forecasting tournaments require participants to submit initial probabilities independently. Academic peer review relies on separate reviews before reviewers see one another’s comments. Even where discussion remains important, independence is preserved long enough to capture separate signals. WCER+2PLOS

Anonymity can sometimes strengthen this effect. Studies of peer review and evaluation processes suggest that reducing status cues can lessen the influence of hierarchy and reputation on collective judgments, although anonymity alone does not solve every decision-quality problem. PLOS+2PMC

Structured Criteria for Hiring Decisions

Hiring provides one of the clearest demonstrations of decision hygiene.

Unstructured interviews often feel insightful because interviewers can follow intuition and explore whatever topics seem interesting. Yet research repeatedly finds that structured interviews tend to be more reliable predictors of performance. The reason is not that intuition disappears; rather, intuition is delayed until after evidence has been gathered systematically. conversableeconomist.com

[A decision-hygiene hiring process typically involves:](#endnote-15 “

• Defining key competencies in advance.
• Evaluating each competency separately.
• Using common questions across candidates.
• Recording scores before discussion.
• Delaying overall impressions until the end. conversableeconomist.com+2William Meller

Kahneman has described structured interviewing as breaking a complex judgment into components, scoring each component independently, and postponing the global evaluation until all evidence has been reviewed. This sequencing reduces halo effects, where one strong or weak characteristic colours every other judgment. conversableeconomist.com

Importantly, decision hygiene does not eliminate intuition altogether. Interviewers may still form an overall impression. The difference is that intuition becomes the final step rather than the first. Structured evidence constrains instinct instead of allowing instinct to shape the evidence. Medium

Structured Criteria for Projects and Investments

Project selection committees frequently face uncertainty, competing priorities, and persuasive advocates. Under these conditions, discussions can become dominated by confidence, storytelling ability, or political influence.

Decision hygiene encourages groups to replace vague judgments such as “This feels promising” with explicit criteria. For example, project proposals might be scored separately on:

• Expected value.
• Strategic fit.
• Cost.
• Technical feasibility.
• Risk.
• Time to implementation.

Separate assessments make disagreements more visible. Committee members can identify whether they disagree about feasibility, expected benefits, or risk rather than arguing about an overall impression. Wiley Online Library+2tosummarise.com

This decomposition also helps combat what researchers have called uniqueness bias: the tendency to treat a project as so special that comparisons become impossible. Structured comparison with previous cases, reference classes, and historical outcomes provides a corrective against overconfident intuition. arXiv

Structured Criteria for Family Decisions

Decision hygiene is not limited to organisations. Families can benefit from the same principles when facing major choices such as moving house, selecting schools, caring for relatives, or making large purchases.

Family discussions often suffer from hidden assumptions. One person may care most about cost, another about convenience, another about long-term opportunities. Without structure, conversations drift into emotional arguments because participants are debating different criteria without realising it.

A simple decision-hygiene approach can include:

• Agreeing on evaluation criteria beforehand.
• Having each person score options independently.
• Comparing scores before debating.
• Identifying the largest disagreements.
• Allowing final intuition only after evidence has been reviewed.

The goal is not to make family decisions mechanical. Rather, it is to ensure that preferences, values, and evidence become visible before personalities and emotions dominate the conversation.

Delayed Final Intuition

One of the most misunderstood aspects of decision hygiene is that it does not seek to eliminate intuition. Instead, it changes when intuition enters the process.

The sequence matters:

1. Define criteria.
2. Gather evidence. [3. Make independent assessments.](#endnote-7 “

1. Compare and discuss. [5. Aggregate judgments.](#endnote-7 “

1. Apply overall intuition at the end.

This order protects intuition from contamination by first impressions while still allowing experienced decision-makers to notice patterns that formal criteria may miss. Kahneman has repeatedly argued that delaying global evaluation is a key safeguard against noisy and biased judgments. conversableeconomist.com+2William Meller

Groups often fear that structure will make decisions rigid or bureaucratic. In practice, good decision hygiene usually preserves discretion while improving consistency. The purpose is not to replace human judgment but to create conditions under which judgment performs better.

What Good Decision Hygiene Looks Like

Groups that consistently make better judgments tend to share a few procedural habits:

• Independent evaluations before discussion.
• Explicit scoring criteria. [* Separation of evidence gathering from decision making.](#endnote-22 “

• Aggregation of multiple judgments rather than reliance on a single authority.
• Delayed overall impressions.
• Regular review of past decisions to identify patterns of inconsistency. Commoncog+2Issues in Science and Technology

These practices matter because the quality of a group decision depends not only on who participates but also on how the decision is made. When intuition receives a structured second pass, groups become less vulnerable to both systematic bias and random noise. The result is not perfect judgment, but a process that is more reliable, fairer, and more likely to capture the collective intelligence of the people involved. PMC+2Issues in Science and Technology

Amazon book picks

Further Reading

Books and field guides related to How Groups Can Catch Bad Intuition. Use these as the next step if you want deeper reading beyond the article.

Book

Noise

By Daniel Kahneman, Olivier Sibony et al.

The core book on noise reduction, judgment consistency, and decision hygiene in organizations and groups.

See on Amazon

Book

Thinking, Fast and Slow

By Daniel Kahneman

Provides the foundational understanding of intuition, bias, and analytical thinking that underpins decision hygiene.

See on Amazon

Book

Decisive

By Chip Heath, Dan Heath

Offers practical frameworks that help groups avoid predictable decision traps and improve judgment quality.

See on Amazon

Book

Superforecasting

By Philip Eyrikson Tetlock, Dan Gardner

Demonstrates how structured thinking, aggregation, and calibrated judgment improve collective decisions.

See on Amazon

Browse more on Amazon:NoiseThinking, Fast and SlowDecisive

As an Amazon Associate I earn from qualifying purchases.

eBay marketplace picks

Marketplace Samples

Example marketplace items related to this page. Use the search link to explore similar finds on eBay.

Shop location

UsingUSA USA USAUKCanadaAustraliaIreland

Example eBay listing

A4 Magnetic Whiteboard & Pin Board Kit Dry Wipe Office Home Notice Eraser Blue

SearcheBay.co.uk: office whiteboard kit

Browse similar oneBay.co.uk

Example eBay listing

A4 Magnetic Whiteboard & Pin Board Kit Dry Wipe Office Home Notice Eraser Black

SearcheBay.co.uk: office whiteboard kit

Browse similar oneBay.co.uk

Example eBay listing

A4 Magnetic Whiteboard & Pin Board Kit Dry Wipe Office Home Notice Eraser Pink

SearcheBay.co.uk: office whiteboard kit

Browse similar oneBay.co.uk

Example eBay listing

Magnetic Whiteboard Sticker, Self-Adhesive Dry Erase Notice Board, Home & Office

SearcheBay.co.uk: office whiteboard kit

Browse similar oneBay.co.uk

Browse more oneBay.co.uk

Example items shown for inspiration; availability and pricing can change. Branchoria may earn a commission if you purchase through outbound eBay links.

Endnotes

2. Source: issues.org
Link:https://issues.org/daniel-kahneman-interview-noise-judgment-decisionmaking/

3. Source: scholarworks.bgsu.edu
Link:https://scholarworks.bgsu.edu/cgi/viewcontent.cgi?article=1039&context=management_pub

4. Source: onlinelibrary.wiley.com
Link:https://onlinelibrary.wiley.com/doi/full/10.1002/aaai.12135

5. Source: pmc.ncbi.nlm.nih.gov
Title: PMCMaking better decisions in groups
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC5579088/

6. Source: arxiv.org
Title: arXiv The effect of diversity on group decision-making
Link:https://arxiv.org/abs/2402.01427

7. Source: commoncog.com
Title: how to reduce decision noise
Link:https://commoncog.com/how-to-reduce-decision-noise/

8. Source: wcer.wisc.edu
Title: WCERHow Group Decision Making in Person and via
Link:https://wcer.wisc.edu/docs/working-papers/Working_Paper_No_2015_06.pdf

9. Source: journals.plos.org
Link:https://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0315674

10. Source: natematias.medium.com
Link:https://natematias.medium.com/bias-and-noise-daniel-kahneman-onerrors-in-decision-making-6bc844ff5194

11. Source: tosummarise.com
Title: decision hygiene
Link:https://www.tosummarise.com/decision-hygiene/

12. Source: arxiv.org
Title: arXiv Uniqueness Bias: Why It Matters, How to Curb It
Link:https://arxiv.org/abs/2408.07710

Published: August 13, 2024

13. Source: arxiv.org
Link:https://arxiv.org/html/2403.01015v1

14. Source: amarks555.medium.com
Title: noise a flaw in human judgment 3fa9b9910a4d
Link:https://amarks555.medium.com/noise-a-flaw-in-human-judgment-3fa9b9910a4d

15. Source: behavioralscientist.org
Title: a conversation with daniel kahneman about noise
Link:https://behavioralscientist.org/a-conversation-with-daniel-kahneman-about-noise/

16. Source: williammeller.com
Title: William Meller Noise by Daniel Kahneman, O
Link:https://williammeller.com/noise-by-daniel-kahneman/

17. Source: theuncertaintyproject.org
Title: They use an archery analogy to illustrate the difference.Read more
Link:https://www.theuncertaintyproject.org/threads/applying-decision-hygiene-to-yield-better-judgment

18. Source: juryanalyst.com
Title: daniel kahneman juror bias cognitive bias
Link:https://juryanalyst.com/daniel-kahneman-juror-bias-cognitive-bias/

20. Source: thedecisionlab.com
Link:https://thedecisionlab.com/big-problems/guiding-effective-group-decision-making-strategies

21. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC11676492/

22. Source: researchgate.net
Title: 228586939 Group decision making
Link:https://www.researchgate.net/publication/228586939_Group_decision_making

23. Source: assets.publishing.service.gov.uk
Title: RR337 Clinical Judgement and Decision Making in Childrens Social Work
Link:https://assets.publishing.service.gov.uk/media/5a7eb33540f0b6230268af9e/RR337_-_Clinical_Judgement_and_Decision-Making_in_Childrens_Social_Work.pdf

24. Source: oxford-review.com
Link:https://oxford-review.com/noise/

Additional References

25. Source: frontiersin.org
Link:https://www.frontiersin.org/guidelines/peer-review-guidelines

26. Source: linkedin.com
Link:https://www.linkedin.com/pulse/how-noise-impacts-recruitment-insights-from-daniel-kahnemans-poxon-jhjfe

27. Source: linkedin.com
Link:https://www.linkedin.com/pulse/noise-leadership-hidden-flaw-business-judgment-bradley-mchugh-ovqhc

28. Source: compare.rm.com
Title: understanding decision hygiene reducing noise and bias with rm compare
Link:https://compare.rm.com/blog/2024/05/understanding-decision-hygiene-reducing-noise-and-bias-with-rm-compare/

Published: May 2024

29. Source: royalsocietypublishing.org
Title: Making better decisions in groups Group decisions
Link:https://royalsocietypublishing.org/rsos/article/4/8/170193/93498/Making-better-decisions-in-groupsGroup-decisions

30. Source: scribd.com
Link:https://www.scribd.com/document/728995946/Interview-Daniel-Kahneman

31. Source: youtube.com
Title: Noise by Daniel Kahneman, Olivier Sibony, and Cass R. Sunstein
Link:https://www.youtube.com/watch?v=OmghBwlYw_Q

32. Source: facebook.com
Link:https://www.facebook.com/groups/1924379581164074/posts/4092410821027595/

33. Source: swizec.com
Title: insights for interviews from kahneman s noise
Link:https://swizec.com/blog/insights-for-interviews-from-kahneman-s-noise/

34. Source: Wikipedia
Title: Noise: A Flaw in Human Judgment
Link:https://en.wikipedia.org/wiki/Noise%3A_A_Flaw_in_Human_Judgment