Within Decision Journal
Was it a bad choice or bad luck?
A good result can hide a weak process, while a bad result can unfairly punish a sound decision made under uncertainty.
On this page
- Why results overpower process in reviews
- The four box review of process and outcome
- How to learn from lucky wins and unlucky losses
Page outline Jump by section
Introduction
Outcome bias is the tendency to judge a decision by what happened rather than by whether it was sensible when it was made. This matters because real decisions are made under uncertainty. A carefully reasoned choice can end badly through bad luck, while a reckless choice can succeed through favourable circumstances. If you use results alone as your scorecard, you risk learning exactly the wrong lesson: abandoning good habits after unlucky losses and reinforcing poor habits after lucky wins. Classic psychological research and modern replications show that people consistently rate the same decision as better or worse depending only on whether they are told it succeeded or failed, even when the decision-maker had identical information in both cases. [PubMed]pubmed.ncbi.nlm.nih.govPub Med Outcome bias in decision evaluationOutcome bias in decision evaluation - PubMed - NIHby J Baron · 1988 · Cited by 1449 — In 5 studies, undergraduate subjects were giv…
Decision journals help counter this problem because they preserve what you knew, believed and expected before the outcome was known. That makes it possible to review the quality of the thinking separately from the quality of the result.
Why results overpower process in reviews
The human mind naturally looks for stories with clear causes. Once an outcome is known, it becomes difficult to imagine the uncertainty that existed beforehand. The result feels like evidence that the decision itself must have been good or bad.
This is attractive because outcomes are visible while reasoning is often hidden. A successful investment is easy to celebrate; the careful probability estimates and alternative scenarios that led to it are invisible. Likewise, a failed product launch attracts criticism even if the available evidence strongly supported the decision at the time.
Psychologists Jonathan Baron and John Hershey demonstrated this effect in a series of influential experiments. Participants read descriptions of decisions involving uncertainty, such as medical treatments and financial gambles. Although the information available to the decision-maker remained identical, participants consistently rated the quality of the thinking more highly when the outcome was favourable than when it was unfavourable. Even participants who believed outcomes should not influence their judgement still showed the bias. [PubMed]pubmed.ncbi.nlm.nih.govPub Med Outcome bias in decision evaluationOutcome bias in decision evaluation - PubMed - NIHby J Baron · 1988 · Cited by 1449 — In 5 studies, undergraduate subjects were giv…
Outcome bias is strengthened by hindsight bias. Once the result is known, people tend to remember events as having been more predictable than they really were. The uncertainty fades from memory, making both success and failure seem inevitable in retrospect. [Wikipedia]WikipediaHindsight biasHindsight bias
The consequence is a distorted feedback system:
- Good outcomes receive too much credit.
- Bad outcomes receive too much blame.
- Luck masquerades as skill.
- Genuine improvements in judgement become harder to identify.
The four-box review of process and outcome
A useful review separates the quality of the decision process from the quality of the outcome. Instead of asking only, “Did it work?”, evaluate both dimensions independently.
ProcessOutcomeWhat it usually meansGoodGoodSound reasoning supported by favourable events. Repeat the process but recognise that luck may also have helped.GoodBadAn unlucky loss. Review assumptions, but do not abandon a disciplined process simply because variance produced a poor result.PoorGoodA lucky win. The success should not become evidence that shortcuts or weak reasoning are reliable.PoorBadBoth the reasoning and the result need attention. This is usually the clearest opportunity for improvement.
The difficult cases are the middle two boxes because they challenge intuition.
A disciplined investor may buy a diversified portfolio before a market decline. The short-term outcome is disappointing, yet the decision may still have been well supported by evidence and appropriate risk management.
Conversely, someone may ignore obvious risks, concentrate their savings in a single speculative investment and make a large profit. The gain does not prove the original reasoning was sound. It may simply reflect fortunate timing.
Decision journals are valuable precisely because they preserve the evidence needed to distinguish these cases months later.
How to learn from lucky wins and unlucky losses
The biggest educational mistake is treating every success as confirmation and every failure as refutation.
Learning from lucky wins
Successful outcomes deserve investigation rather than celebration alone.
Ask questions such as:
- Which assumptions were actually correct?
- Which risks simply failed to materialise?
- Would I make the same decision again under identical uncertainty?
- If this situation occurred 100 times, would I expect similar results?
These questions reduce the temptation to confuse survival with skill.
Learning from unlucky losses
Poor outcomes deserve analysis without automatic self-criticism.
Useful questions include:
- Did I use the best information available at the time?
- Did I consider realistic alternatives?
- Were my probability estimates reasonable?
- Did unexpected events occur that no reasonable analysis could have predicted?
Sometimes the review will reveal genuine mistakes. Other times it will show that an acceptable decision encountered unfavourable randomness.
Separating these possibilities preserves confidence in good analytical habits while still allowing genuine errors to be corrected.
Decision journals make fairer reviews possible
Outcome bias is especially powerful because memory changes after the fact. Once you know what happened, it becomes surprisingly difficult to reconstruct what you genuinely believed beforehand. A decision journal prevents this reconstruction by creating a contemporaneous record of your reasoning.
A useful review therefore compares three things:
- What information was available before acting.
- What reasoning led to the decision.
- What later happened, including unexpected events.
This sequence keeps the outcome from rewriting the decision itself. Instead of asking whether success or failure proves competence, you ask whether the original reasoning was appropriate given the uncertainty that existed at the time.
That distinction creates a much more reliable learning system. Over many decisions, consistently good processes tend to outperform consistently poor ones, even though individual outcomes will always contain an element of luck. Treating process and outcome as separate signals helps decision journals fulfil their real purpose: improving judgement rather than merely keeping score.
eBay marketplace picks
Marketplace Samples
Live-tested eBay searches with available results related to this page.
Endnotes
-
Source: Wikipedia
Title: Hindsight bias
Link: https://en.wikipedia.org/wiki/Hindsight_bias -
Source: Wikipedia
Title: Outcome bias
Link: https://en.wikipedia.org/wiki/Outcome_biasSource snippet
Outcome biasThe outcome bias is an error made in evaluating the quality of a decision when the outcome of that decision is already kno...
-
Source: pubmed.ncbi.nlm.nih.gov
Title: Pub Med Outcome bias in decision evaluation
Link: https://pubmed.ncbi.nlm.nih.gov/3367280/Source snippet
Outcome bias in decision evaluation - PubMed - NIHby J Baron · 1988 · Cited by 1449 — In 5 studies, undergraduate subjects were giv...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12372742/Source snippet
Affect Evaluations of Decision Quality: [Replication]({{ 'replication/' | relative_url }})...
Additional References
-
Source: newristics.com
Link: https://newristics.com/heuristics-biases/outcome-biasSource snippet
Definition, Example & How Outcome Bias WorksOutcome bias refers to the tendency to judge a decision or action based on its outcome rather...
-
Source: thedecisionlab.com
Link: https://thedecisionlab.com/biases/outcome-biasSource snippet
Outcome bias: Why we blame bad results, not bad reasoningOutcome bias is a cognitive bias where we evaluate decisions primarily by how th...
-
Source: hermes.cde.state.co.us
Link: https://hermes.cde.state.co.us/islandora/object/co%3A31690/datastream/OBJ/download/Outcome_bias_in_decision_evaluation.pdfSource snippet
Bias in Decision EvaluationIn all five experiments, researchers found that the outcome was the factor attributed to quality decision maki...
-
Source: researchgate.net
Title: 19789598 Outcome Bias in Decision Evaluation
Link: https://www.researchgate.net/publication/19789598_Outcome_Bias_in_Decision_EvaluationSource snippet
(PDF) Outcome Bias in Decision EvaluationBaron and Hershey (1988) found that people tend to judge the quality of a decision based on the...
-
Source: bear.warrington.ufl.edu
Link: https://bear.warrington.ufl.edu/brenner/mar7588/Papers/baron-hershey-jpsp1988.pdfSource snippet
Bias in Decision Evaluationby J Baron · 1988 · Cited by 1454 — In this paper, we explore how well the distinction between decisions and o...
-
Source: psychologytoday.com
Title: why you shouldnt judge decisions by results alone
Link: https://www.psychologytoday.com/gb/blog/decisions-and-the-brain/202509/why-you-shouldnt-judge-decisions-by-results-aloneSource snippet
Baron, J., & Hershey, J. C. (1988).Read more...
-
Source: rips-irsp.com
Link: https://rips-irsp.com/articles/10.5334/irsp.751Source snippet
Rev. Soc. Psychol.Outcomes Affect Evaluations of Decision Qualityby S Aiyer · 2023 · Cited by 4 — Research by Baron and Hershey (1988) de...
-
Source: youtube.com
Title: Every Decision Is a Bet: How Smart Leaders Think
Link: https://www.youtube.com/watch?v=K2WKAXNZ1X0Source snippet
5 Tools for Better Decisions | The Decision Dividend #34...
-
Source: youtube.com
Title: Overcoming Outcome Bias: How to Improve Learning & Decision Making
Link: https://www.youtube.com/watch?v=o_rW4jCOB4cSource snippet
The Learner Lab...
-
Source: youtube.com
Title: Judging Decisions by Their Outcomes?
Link: https://www.youtube.com/watch?v=VtZw_9SQxF4Source snippet
Outcome Bias Explained With Rolf Dobelli...
Topic Tree