Within Problem Framing
A Checklist Before the Big Decision
Structured checks can expose missing alternatives, weak evidence, and overconfident numbers before a major decision.
On this page
- Why leaders need pre decision checks
- Testing alternatives and evidence quality
- Using checklists without turning them into bureaucracy
Page outline Jump by section
Introduction
Before a major decision gains momentum, the most valuable question is often not “What should we do?” but “Are we solving the right problem in the right way?” Decision-quality checklists exist to test the problem frame before persuasive arguments, political commitments, or detailed analysis make the original framing difficult to challenge. Rather than predicting the correct answer, these checklists help decision-makers detect missing alternatives, weak evidence, hidden assumptions, and unjustified confidence. Research on decision quality consistently identifies framing, alternatives, information quality, and reasoning quality as core determinants of good decisions, regardless of the eventual outcome.[Decision Professionals+2Rockflow]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…
A useful checklist is therefore not a bureaucratic form. It is a structured attempt to answer a simple question: “If this frame is wrong, how would we know before committing resources?”
Why Leaders Need Pre-Decision Checks
Many poor decisions begin with a frame that feels obvious. Once a team agrees that a problem is caused by one factor, evidence gathering often becomes a search for confirmation rather than a search for understanding. Studies of cognitive bias show that professionals remain vulnerable to overconfidence, confirmation bias, anchoring, and related judgement errors even when they possess expertise and experience.[PMC]pmc.ncbi.nlm.nih.govThe Impact of Cognitive Biases on Professionals' Decision…by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows…
This is why decision-quality practitioners distinguish between decision quality and outcome quality. A good outcome can result from a flawed process, just as a sound process can sometimes produce a disappointing outcome because of uncertainty. The quality check occurs before the outcome is known.[PMC Training]pmctraining.comPMC Training The Decision-Making Mistake That Costs Teams the MostDecision quality is an assessment of the reasoning process at the moment a decision was made.Read more…
A pre-decision checklist is especially valuable when:
- The decision is expensive or difficult to reverse.
- Stakeholders strongly favour one explanation.
- Forecasts contain substantial uncertainty.
- Time pressure encourages premature agreement.
- The proposed solution emerged before the problem was carefully defined.
In these situations, the checklist acts as a forcing mechanism that slows commitment long enough to examine whether the frame itself deserves confidence.
A Checklist Before the Big Decision
The following checklist focuses specifically on testing the problem frame, not on evaluating detailed solutions.
1. Have We Defined the Purpose Clearly?
A frame should state what success looks like rather than merely describe what is currently frustrating.
Questions to ask:
- What decision are we actually trying to make?
- What outcome are we trying to improve?
- How will we know the problem has been solved?
- Are we describing a symptom or an underlying issue?
A useful warning sign is solution language embedded in the problem statement. For example, “How do we automate this process?” already assumes automation is the answer. A stronger frame asks what performance gap exists and what outcomes matter.
2. Have We Considered Genuine Alternatives?
Decision-quality frameworks consistently emphasise the importance of creative, workable alternatives because a decision with only one apparent option is often not a real decision.[Decision Professionals+2Sokkeldirektoratet]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…
Questions to ask:
- What are at least three fundamentally different ways to view this problem?
- If our preferred explanation were false, what else could explain the situation?
- What option would a sceptical outsider propose?
- What happens if we do nothing?
The objective is not to generate endless possibilities. It is to prevent the first framing from monopolising attention.
3. What Evidence Would Change Our Minds?
Weak frames often survive because teams collect supporting evidence but never identify disconfirming evidence.
Questions to ask:
- What facts would seriously challenge our current framing?
- Have we actively searched for contradictory evidence?
- Are we relying on anecdotes when broader data exist?
- Which assumptions are supported by evidence and which are merely plausible?
This check helps counter confirmation bias and congruence bias, both of which encourage people to test whether their preferred explanation is correct rather than whether competing explanations might fit better.[PSA]professionalstandards.org.ukAs is.Read morePSAAdvice on biases in fitness to practise decision-making…June 10, 2021 — Congruence bias – tied to confirmation bias this is where t…
4. Are We Confusing Precision with Certainty?
Decision-makers often become more confident than their evidence justifies. Research identifies overconfidence as one of the most common and persistent biases in professional judgement.[PMC+2Economic and Business Review]pmc.ncbi.nlm.nih.govThe Impact of Cognitive Biases on Professionals' Decision…by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows…
Questions to ask:
- Which numbers are estimates rather than measurements?
- What confidence range accompanies our forecasts?
- Are we using precise figures that imply more certainty than exists?
- What assumptions would have to remain true for our prediction to hold?
A forecast stated as “12.7%” may appear rigorous while resting on highly uncertain assumptions. The checklist should force discussion of uncertainty, not merely calculations.
5. Have We Examined the Frame from Other Perspectives?
Problem frames determine what gets included and excluded from consideration. Decision education research describes a helpful frame as one that clarifies purpose, scope, and perspective.[decisioneducation.org]decisioneducation.orgHelpful FrameA decision frame has three components: (1) Purpose—what we hope to accomplish by this decision; (2) Scope—what to include an…
Questions to ask:
- Who experiences this problem differently?
- Which stakeholders would describe the issue in another way?
- What information sits outside our current scope but may matter?
- What would the problem look like from the customer’s, citizen’s, employee’s, or competitor’s perspective?
A frame that survives multiple viewpoints is generally stronger than one that depends on a single perspective.
Testing Alternatives and Evidence Quality
The strongest framing checks combine alternative generation with evidence review rather than treating them as separate activities.
One practical technique is to create competing problem statements and compare the evidence supporting each. For example:
- Customer dissatisfaction is caused by slow service.
- Customer dissatisfaction is caused by unclear expectations.
- Customer dissatisfaction is caused by inconsistent quality.
The team then asks which evidence supports each frame and what evidence contradicts it. This prevents the discussion from becoming a contest between advocates of one preferred explanation.
Another useful approach is the pre-mortem. Developed by cognitive psychologist Gary Klein, a pre-mortem asks participants to imagine that a proposed plan has already failed and then identify the reasons why. By assuming failure rather than merely discussing possible risks, teams often surface concerns that would otherwise remain unspoken. Research and practitioner accounts suggest that this “prospective hindsight” approach improves the identification of weaknesses and hidden assumptions.[Psychology Today+3Harvard Business Review+3garyklein]hbr.orgperforming a project premortemHarvard Business ReviewPerforming a Project PremortemReprint: F0709A In a premortem, team members assume that the project they are planni…
For problem framing, the pre-mortem question becomes:
“Suppose we discover in two years that we framed the problem incorrectly. What did we overlook?”
The answers often reveal missing stakeholders, ignored constraints, weak evidence, or untested assumptions.
Using Checklists Without Turning Them Into Bureaucracy
A common criticism of decision checklists is that they can become mechanical exercises completed merely to satisfy a process requirement. That risk is real. Aviation and medicine demonstrate that checklists work best when they focus attention on critical failure points rather than attempting to capture every detail.[DIVA Portal]diva-portal.orgDIVA Portal Systematically Irrational Decision MakingDIVA PortalSystematically Irrational Decision MakingJune 17, 2016 — by J Duintjer · Cited by 1 — a 12-question checklist which decision m…
Several principles help preserve their value:
Keep them short. A framing checklist should usually fit on one page. If it requires extensive explanation, people stop using it.
Use questions, not boxes. The goal is discussion. Questions reveal assumptions more effectively than yes-or-no compliance checks.
Apply more scrutiny to bigger decisions. A minor operational choice does not need the same framing review as a strategic investment.
Encourage challenge. A checklist loses value if participants believe that questioning the frame is politically risky.
Review before commitment. The ideal moment is before resources, reputation, or public promises become tied to a particular answer.
The purpose of a decision-quality checklist is not to guarantee correctness. It is to increase the odds that reasoning begins from a frame that has survived serious testing. By exposing weak assumptions, unexplored alternatives, and unsupported confidence early, these checks improve the quality of judgement before analysis becomes attached to a potentially flawed definition of the problem.[Decision Professionals+2Rockflow]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…
Amazon book picks
Further Reading
Books and field guides related to A Checklist Before the Big Decision. Use these as the next step if you want deeper reading beyond the article.
Decisive
Provides practical methods for widening options, testing assumptions, and improving major decisions before commitment.
Thinking, Fast and Slow
Explains cognitive biases, framing effects, overconfidence, and judgment errors that decision-quality checklists are designed to catch.
Thinking in Bets
Focuses on uncertainty, evidence quality, and separating decision quality from outcome quality.
Smart Choices
Directly addresses framing, alternatives, objectives, trade-offs, and structured decision processes.
Endnotes
1.
Source: rockflow.com
Title: Why Decision Quality is important (and why it so easily falters)1
Link:https://rockflow.com/why-decision-quality-is-important-and-why-it-so-easily-falters/
Source snippet
Clear and appropriate frame · 2. Creative and doable alternatives · 3. Meaningful and reliable information · 4. Clear values and tradeoff...
2.
Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC8763848/
Source snippet
The Impact of Cognitive Biases on Professionals' Decision...by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows...
3.
Source: professionalstandards.org.uk
Title: As is.Read more
Link:https://www.professionalstandards.org.uk/sites/default/files/attachments/Advice%20on%20biases%20in%20fitness%20to%20practise%20decision-making%20models.pdf
Source snippet
PSAAdvice on biases in fitness to practise decision-making...June 10, 2021 — Congruence bias – tied to confirmation bias this is where t...
Published: June 10, 2021
4.
Source: decisioneducation.org
Link:https://www.decisioneducation.org/decision-chain/helpful-frame
Source snippet
Helpful FrameA decision frame has three components: (1) Purpose—what we hope to accomplish by this decision; (2) Scope—what to include an...
5.
Source: gary-klein.com
Link:https://www.gary-klein.com/premortem
Source snippet
Premortem | garykleinA premortem is an exercise that typically begins after a team has been briefed on a plan. The team leader will ask h...
6.
Source: diva-portal.org
Title: DIVA Portal Systematically Irrational Decision Making
Link:https://www.diva-portal.org/smash/get/diva2%3A937319/FULLTEXT02.pdf
Source snippet
DIVA PortalSystematically Irrational Decision MakingJune 17, 2016 — by J Duintjer · Cited by 1 — a 12-question checklist which decision m...
Published: June 17, 2016
7.
Source: decisionprofessionals.com
Link:https://www.decisionprofessionals.com/who-we-are/decision-quality
Source snippet
Decision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha...
8.
Source: pmctraining.com
Title: PMC Training The Decision-Making Mistake That Costs Teams the Most
Link:https://pmctraining.com/articles-and-resources/decision-quality-vs-outcome-quality/
Source snippet
Decision quality is an assessment of the reasoning process at the moment a decision was made.Read more...
9.
Source: sodir.no
Title: force dq lunch learn
Link:https://www.sodir.no/48f51b/globalassets/2-force/2020/seminars/01.17-organizational-decision-quality-value-creation-by-high-quality-decisions/force-dq-lunch–learn.pdf
Source snippet
SokkeldirektoratetDecision QualityHow a decision is framed can alter the decision people make. Imagine that... Alternatives. © 2020 by S...
10.
Source: ebrjournal.net
Link:https://www.ebrjournal.net/cgi/viewcontent.cgi?article=1338&context=home
Source snippet
Economic and Business ReviewA Systematic Literature Review on Overconfidence and...by U Karki · 2024 · Cited by 50 — To understand the r...
11.
Source: hbr.org
Title: performing a project premortem
Link:https://hbr.org/2007/09/performing-a-project-premortem
Source snippet
Harvard Business ReviewPerforming a Project PremortemReprint: F0709A In a premortem, team members assume that the project they are planni...
12.
Source: psychologytoday.com
Title: the pre mortem method
Link:https://www.psychologytoday.com/au/blog/seeing-what-others-dont/202101/the-pre-mortem-method
Source snippet
The Pre-Mortem Method14 Jan 2021 — The pre-mortem method has a number of benefits besides identifying trouble spots in a plan, reducing o...
13.
Source: cltr.nl
Link:https://cltr.nl/wp-content/uploads/2020/11/Project-Pre-Mortem-HBR-Gary-Klein.pdf
Source snippet
Performing a Project Premortem - CLTRby G Klein · 2007 · Cited by 589 — In the end, a premortem may be the best way to cir- cumvent any n...
14.
Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC3704204/
Source snippet
Synthesis for Decision Making 7 - PMC - NIHby AE Ades · 2013 · Cited by 118 — This checklist is for the review of evidence syntheses for...
Additional References
15.
Source: theuncertaintyproject.org
Link:https://www.theuncertaintyproject.org/tools/pre-mortem
Source snippet
Pre-MortemDeveloped by Gary Klein, the pre-mortem analysis is a tool intended to increase the probability of a project's success. It is b...
16.
Source: thedecisionlab.com
Link:https://thedecisionlab.com/biases/framing-effect
17.
Source: jbsfm.org
Link:https://jbsfm.org/vol3no1/biases-in-managerial-decision-making–overconfidence–status-quo–anchoring–hindsight–[availability
Source snippet
Biases in Managerial Decision Making: Overconfidence...30 Jul 2021 — In this context, five biases in the behavioral finance literature...
18.
Source: youtube.com
Link:https://www.youtube.com/watch?v=dFV-lzIqfRA
Source snippet
Fundamentals of Decision QualityThis webinar is for relatively new "DQ professionals," i.e., those who support senior executives in makin...
19.
Source: youtube.com
Link:http://www.youtube.com/watch?v=6sbsBlWVnfw
Source snippet
"Decision Quality" framing checklist The Psychology of Decision Making Explained Simply in 12 Minutes BEducated...
20.
Source: sdg.com
Link:https://sdg.com/decision-quality/
Source snippet
nagers to achieve the most impact from their work.Read more...
21.
Source: youtube.com
Link:http://www.youtube.com/watch?v=vL6uiALEdkk
Source snippet
Decision Quality: How to Make the Right Choice the First Time | SDG Decision Education Center...
22.
Source: scrum.org
Title: three ai skills sharpen judgment
Link:https://www.scrum.org/resources/blog/three-ai-skills-sharpen-judgment
Source snippet
Three AI Skills to Sharpen Judgment16 Mar 2026 — [1] Gary Klein built the pre-mortem technique on this finding. The... hidden assumption...
23.
Source: investigationsquality.com
Title: Investigations of a Dog Decision Quality
Link:https://investigationsquality.com/2019/11/20/decision-quality/
Source snippet
The six requirements for a good decision are: (1) an appropriate frame, (2) creative alternatives, (3) relevant...Read more...
24.
Source: strategyunitwm.nhs.uk
Link:https://www.strategyunitwm.nhs.uk/sites/default/files/2018-12/SU%20guide%20to…the%20premortem.pdf
Source snippet
The Pre-MortemThe pre-mortem technique was developed by Klein (2007) using 'prospective hindsight' to identify risks. The original Harvar...
Topic Tree



