Within Problem Framing

A Checklist Before the Big Decision

Structured checks can expose missing alternatives, weak evidence, and overconfident numbers before a major decision.

33 sources 3 graphics

On this page

  • Why leaders need pre decision checks
  • Testing alternatives and evidence quality
  • Using checklists without turning them into bureaucracy
Preview for A Checklist Before the Big Decision

Introduction

Before a major decision gains momentum, the most valuable question is often not “What should we do?” but “Are we solving the right problem in the right way?” Decision-quality checklists exist to test the problem frame before persuasive arguments, political commitments, or detailed analysis make the original framing difficult to challenge. Rather than predicting the correct answer, these checklists help decision-makers detect missing alternatives, weak evidence, hidden assumptions, and unjustified confidence. Research on decision quality consistently identifies framing, alternatives, information quality, and reasoning quality as core determinants of good decisions, regardless of the eventual outcome.[Decision Professionals+2Rockflow]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…

Decision Checks illustration 1 A useful checklist is therefore not a bureaucratic form. It is a structured attempt to answer a simple question: “If this frame is wrong, how would we know before committing resources?”

Why Leaders Need Pre-Decision Checks

Many poor decisions begin with a frame that feels obvious. Once a team agrees that a problem is caused by one factor, evidence gathering often becomes a search for confirmation rather than a search for understanding. Studies of cognitive bias show that professionals remain vulnerable to overconfidence, confirmation bias, anchoring, and related judgement errors even when they possess expertise and experience.[PMC]pmc.ncbi.nlm.nih.govThe Impact of Cognitive Biases on Professionals' Decision…by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows…

This is why decision-quality practitioners distinguish between decision quality and outcome quality. A good outcome can result from a flawed process, just as a sound process can sometimes produce a disappointing outcome because of uncertainty. The quality check occurs before the outcome is known.[PMC Training]pmctraining.comPMC Training The Decision-Making Mistake That Costs Teams the MostDecision quality is an assessment of the reasoning process at the moment a decision was made.Read more…

A pre-decision checklist is especially valuable when:

  • The decision is expensive or difficult to reverse.
  • Stakeholders strongly favour one explanation.
  • Forecasts contain substantial uncertainty.
  • Time pressure encourages premature agreement.
  • The proposed solution emerged before the problem was carefully defined.

In these situations, the checklist acts as a forcing mechanism that slows commitment long enough to examine whether the frame itself deserves confidence.

A Checklist Before the Big Decision

The following checklist focuses specifically on testing the problem frame, not on evaluating detailed solutions.

1. Have We Defined the Purpose Clearly?

A frame should state what success looks like rather than merely describe what is currently frustrating.

Questions to ask:

  • What decision are we actually trying to make?
  • What outcome are we trying to improve?
  • How will we know the problem has been solved?
  • Are we describing a symptom or an underlying issue?

A useful warning sign is solution language embedded in the problem statement. For example, “How do we automate this process?” already assumes automation is the answer. A stronger frame asks what performance gap exists and what outcomes matter.

2. Have We Considered Genuine Alternatives?

Decision-quality frameworks consistently emphasise the importance of creative, workable alternatives because a decision with only one apparent option is often not a real decision.[Decision Professionals+2Sokkeldirektoratet]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…

Questions to ask:

  • What are at least three fundamentally different ways to view this problem?
  • If our preferred explanation were false, what else could explain the situation?
  • What option would a sceptical outsider propose?
  • What happens if we do nothing?

The objective is not to generate endless possibilities. It is to prevent the first framing from monopolising attention.

3. What Evidence Would Change Our Minds?

Weak frames often survive because teams collect supporting evidence but never identify disconfirming evidence.

Questions to ask:

  • What facts would seriously challenge our current framing?
  • Have we actively searched for contradictory evidence?
  • Are we relying on anecdotes when broader data exist?
  • Which assumptions are supported by evidence and which are merely plausible?

This check helps counter confirmation bias and congruence bias, both of which encourage people to test whether their preferred explanation is correct rather than whether competing explanations might fit better.[PSA]professionalstandards.org.ukAs is.Read morePSAAdvice on biases in fitness to practise decision-making…June 10, 2021 — Congruence bias – tied to confirmation bias this is where t…Published: June 10, 2021

Decision Checks illustration 2

4. Are We Confusing Precision with Certainty?

Decision-makers often become more confident than their evidence justifies. Research identifies overconfidence as one of the most common and persistent biases in professional judgement.[PMC+2Economic and Business Review]pmc.ncbi.nlm.nih.govThe Impact of Cognitive Biases on Professionals' Decision…by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows…

Questions to ask:

  • Which numbers are estimates rather than measurements?
  • What confidence range accompanies our forecasts?
  • Are we using precise figures that imply more certainty than exists?
  • What assumptions would have to remain true for our prediction to hold?

A forecast stated as “12.7%” may appear rigorous while resting on highly uncertain assumptions. The checklist should force discussion of uncertainty, not merely calculations.

5. Have We Examined the Frame from Other Perspectives?

Problem frames determine what gets included and excluded from consideration. Decision education research describes a helpful frame as one that clarifies purpose, scope, and perspective.[decisioneducation.org]decisioneducation.orgHelpful FrameA decision frame has three components: (1) Purpose—what we hope to accomplish by this decision; (2) Scope—what to include an…

Questions to ask:

  • Who experiences this problem differently?
  • Which stakeholders would describe the issue in another way?
  • What information sits outside our current scope but may matter?
  • What would the problem look like from the customer’s, citizen’s, employee’s, or competitor’s perspective?

A frame that survives multiple viewpoints is generally stronger than one that depends on a single perspective.

Testing Alternatives and Evidence Quality

The strongest framing checks combine alternative generation with evidence review rather than treating them as separate activities.

One practical technique is to create competing problem statements and compare the evidence supporting each. For example:

  • Customer dissatisfaction is caused by slow service.
  • Customer dissatisfaction is caused by unclear expectations.
  • Customer dissatisfaction is caused by inconsistent quality.

The team then asks which evidence supports each frame and what evidence contradicts it. This prevents the discussion from becoming a contest between advocates of one preferred explanation.

Another useful approach is the pre-mortem. Developed by cognitive psychologist Gary Klein, a pre-mortem asks participants to imagine that a proposed plan has already failed and then identify the reasons why. By assuming failure rather than merely discussing possible risks, teams often surface concerns that would otherwise remain unspoken. Research and practitioner accounts suggest that this “prospective hindsight” approach improves the identification of weaknesses and hidden assumptions.[Psychology Today+3Harvard Business Review+3garyklein]hbr.orgperforming a project premortemHarvard Business ReviewPerforming a Project PremortemReprint: F0709A In a premortem, team members assume that the project they are planni…

For problem framing, the pre-mortem question becomes:

“Suppose we discover in two years that we framed the problem incorrectly. What did we overlook?”

The answers often reveal missing stakeholders, ignored constraints, weak evidence, or untested assumptions.

Decision Checks illustration 3

Using Checklists Without Turning Them Into Bureaucracy

A common criticism of decision checklists is that they can become mechanical exercises completed merely to satisfy a process requirement. That risk is real. Aviation and medicine demonstrate that checklists work best when they focus attention on critical failure points rather than attempting to capture every detail.[DIVA Portal]diva-portal.orgDIVA Portal Systematically Irrational Decision MakingDIVA PortalSystematically Irrational Decision MakingJune 17, 2016 — by J Duintjer · Cited by 1 — a 12-question checklist which decision m…Published: June 17, 2016

Several principles help preserve their value:

Keep them short. A framing checklist should usually fit on one page. If it requires extensive explanation, people stop using it.

Use questions, not boxes. The goal is discussion. Questions reveal assumptions more effectively than yes-or-no compliance checks.

Apply more scrutiny to bigger decisions. A minor operational choice does not need the same framing review as a strategic investment.

Encourage challenge. A checklist loses value if participants believe that questioning the frame is politically risky.

Review before commitment. The ideal moment is before resources, reputation, or public promises become tied to a particular answer.

The purpose of a decision-quality checklist is not to guarantee correctness. It is to increase the odds that reasoning begins from a frame that has survived serious testing. By exposing weak assumptions, unexplored alternatives, and unsupported confidence early, these checks improve the quality of judgement before analysis becomes attached to a potentially flawed definition of the problem.[Decision Professionals+2Rockflow]decisionprofessionals.comDecision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha…

Amazon book picks

Further Reading

Books and field guides related to A Checklist Before the Big Decision. Use these as the next step if you want deeper reading beyond the article.

BookCover for Decisive

Decisive

By Chip Heath, Dan Heath

Provides practical methods for widening options, testing assumptions, and improving major decisions before commitment.

BookCover for Smart Choices

Smart Choices

By John S. Hammond, Ralph L. Keeney et al.

Directly addresses framing, alternatives, objectives, trade-offs, and structured decision processes.

eBay marketplace picks

Marketplace Samples

Example marketplace items related to this page. Use the search link to explore similar finds on eBay.

UsingUSA

Endnotes

1. Source: rockflow.com
Title: Why Decision Quality is important (and why it so easily falters)1
Link:https://rockflow.com/why-decision-quality-is-important-and-why-it-so-easily-falters/

Source snippet

Clear and appropriate frame · 2. Creative and doable alternatives · 3. Meaningful and reliable information · 4. Clear values and tradeoff...

2. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC8763848/

Source snippet

The Impact of Cognitive Biases on Professionals' Decision...by V Berthet · 2022 · Cited by 305 — First, the literature reviewed shows...

3. Source: professionalstandards.org.uk
Title: As is.Read more
Link:https://www.professionalstandards.org.uk/sites/default/files/attachments/Advice%20on%20biases%20in%20fitness%20to%20practise%20decision-making%20models.pdf

Source snippet

PSAAdvice on biases in fitness to practise decision-making...June 10, 2021 — Congruence bias – tied to confirmation bias this is where t...

Published: June 10, 2021

4. Source: decisioneducation.org
Link:https://www.decisioneducation.org/decision-chain/helpful-frame

Source snippet

Helpful FrameA decision frame has three components: (1) Purpose—what we hope to accomplish by this decision; (2) Scope—what to include an...

5. Source: gary-klein.com
Link:https://www.gary-klein.com/premortem

Source snippet

Premortem | garykleinA premortem is an exercise that typically begins after a team has been briefed on a plan. The team leader will ask h...

6. Source: diva-portal.org
Title: DIVA Portal Systematically Irrational Decision Making
Link:https://www.diva-portal.org/smash/get/diva2%3A937319/FULLTEXT02.pdf

Source snippet

DIVA PortalSystematically Irrational Decision MakingJune 17, 2016 — by J Duintjer · Cited by 1 — a 12-question checklist which decision m...

Published: June 17, 2016

7. Source: decisionprofessionals.com
Link:https://www.decisionprofessionals.com/who-we-are/decision-quality

Source snippet

Decision ProfessionalsDecision QualityThis framework proposed captures the quality of decisions, with the evidence that all decisions sha...

8. Source: pmctraining.com
Title: PMC Training The Decision-Making Mistake That Costs Teams the Most
Link:https://pmctraining.com/articles-and-resources/decision-quality-vs-outcome-quality/

Source snippet

Decision quality is an assessment of the reasoning process at the moment a decision was made.Read more...

9. Source: sodir.no
Title: force dq lunch learn
Link:https://www.sodir.no/48f51b/globalassets/2-force/2020/seminars/01.17-organizational-decision-quality-value-creation-by-high-quality-decisions/force-dq-lunch–learn.pdf

Source snippet

SokkeldirektoratetDecision QualityHow a decision is framed can alter the decision people make. Imagine that... Alternatives. © 2020 by S...

10. Source: ebrjournal.net
Link:https://www.ebrjournal.net/cgi/viewcontent.cgi?article=1338&context=home

Source snippet

Economic and Business ReviewA Systematic Literature Review on Overconfidence and...by U Karki · 2024 · Cited by 50 — To understand the r...

11. Source: hbr.org
Title: performing a project premortem
Link:https://hbr.org/2007/09/performing-a-project-premortem

Source snippet

Harvard Business ReviewPerforming a Project PremortemReprint: F0709A In a premortem, team members assume that the project they are planni...

12. Source: psychologytoday.com
Title: the pre mortem method
Link:https://www.psychologytoday.com/au/blog/seeing-what-others-dont/202101/the-pre-mortem-method

Source snippet

The Pre-Mortem Method14 Jan 2021 — The pre-mortem method has a number of benefits besides identifying trouble spots in a plan, reducing o...

13. Source: cltr.nl
Link:https://cltr.nl/wp-content/uploads/2020/11/Project-Pre-Mortem-HBR-Gary-Klein.pdf

Source snippet

Performing a Project Premortem - CLTRby G Klein · 2007 · Cited by 589 — In the end, a premortem may be the best way to cir- cumvent any n...

14. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC3704204/

Source snippet

Synthesis for Decision Making 7 - PMC - NIHby AE Ades · 2013 · Cited by 118 — This checklist is for the review of evidence syntheses for...

Additional References

15. Source: theuncertaintyproject.org
Link:https://www.theuncertaintyproject.org/tools/pre-mortem

Source snippet

Pre-MortemDeveloped by Gary Klein, the pre-mortem analysis is a tool intended to increase the probability of a project's success. It is b...

16. Source: thedecisionlab.com
Link:https://thedecisionlab.com/biases/framing-effect

17. Source: jbsfm.org
Link:https://jbsfm.org/vol3no1/biases-in-managerial-decision-making–overconfidence–status-quo–anchoring–hindsight–[availability

Source snippet

Biases in Managerial Decision Making: Overconfidence...30 Jul 2021 — In this context, five biases in the behavioral finance literature...

18. Source: youtube.com
Link:https://www.youtube.com/watch?v=dFV-lzIqfRA

Source snippet

Fundamentals of Decision QualityThis webinar is for relatively new "DQ professionals," i.e., those who support senior executives in makin...

19. Source: youtube.com
Link:http://www.youtube.com/watch?v=6sbsBlWVnfw

Source snippet

"Decision Quality" framing checklist The Psychology of Decision Making Explained Simply in 12 Minutes BEducated...

20. Source: sdg.com
Link:https://sdg.com/decision-quality/

Source snippet

nagers to achieve the most impact from their work.Read more...

21. Source: youtube.com
Link:http://www.youtube.com/watch?v=vL6uiALEdkk

Source snippet

Decision Quality: How to Make the Right Choice the First Time | SDG Decision Education Center...

22. Source: scrum.org
Title: three ai skills sharpen judgment
Link:https://www.scrum.org/resources/blog/three-ai-skills-sharpen-judgment

Source snippet

Three AI Skills to Sharpen Judgment16 Mar 2026 — [1] Gary Klein built the pre-mortem technique on this finding. The... hidden assumption...

23. Source: investigationsquality.com
Title: Investigations of a Dog Decision Quality
Link:https://investigationsquality.com/2019/11/20/decision-quality/

Source snippet

The six requirements for a good decision are: (1) an appropriate frame, (2) creative alternatives, (3) relevant...Read more...

24. Source: strategyunitwm.nhs.uk
Link:https://www.strategyunitwm.nhs.uk/sites/default/files/2018-12/SU%20guide%20to…the%20premortem.pdf

Source snippet

The Pre-MortemThe pre-mortem technique was developed by Klein (2007) using 'prospective hindsight' to identify risks. The original Harvar...

Topic Tree

Follow this branch

Parent topic

Problem Framing Are You Solving the Right Problem?

Related pages 5