Why Experience Alone Does Not Fix Thinking

Introduction

Experience alone does not reliably fix poor thinking. People can spend years making decisions, reading arguments, joining debates or analysing problems while quietly rehearsing the same shortcuts, blind spots and overconfidence. Deliberate practice changes that pattern by turning reasoning into a trainable performance: isolate a subskill, attempt a hard but manageable task, get feedback, revise the method, and repeat until the improved habit becomes easier to use under pressure. In research on expertise, deliberate practice is usually defined by focused tasks, immediate feedback, opportunities to evaluate errors, and repeated refinement rather than by the raw number of hours spent “doing” an activity.[PubMed]pubmed.ncbi.nlm.nih.govDeliberate practice and acquisition of expert performanceby KA Ericsson · 2008 · Cited by 2927 — DP also involves the provision of…

For thinking and analytical skills, this matters because the goal is not to become more argumentative or more confident. The goal is to become more corrigible: better at noticing when a conclusion is weak, when evidence is missing, when confidence is inflated, and when a problem needs a different reasoning strategy. Studies of critical-thinking instruction, argument mapping, debiasing and forecasting all point towards the same practical lesson: reasoning improves most when practice is explicit, repeated, feedback-rich and tied to visible performance rather than left as a vague aspiration.[Sage Journals+2City Research Online]journals.sagepub.comFirst, the evidence on…Read more…

What deliberate practice changes

The central shift is from “I thought about it” to “I practised a specific move and checked whether it worked”. In ordinary experience, feedback is often delayed, noisy or absent. A manager may make a hiring decision and never know whether a rejected candidate would have been better. A student may write an essay, receive a grade, and still not know which inference failed. A clinician, analyst or investor may be rewarded by luck and punished despite good reasoning. Without clean feedback, repeated exposure can strengthen habits that feel fluent but are not accurate.

Deliberate practice tries to make reasoning observable. Instead of treating judgement as a private mental event, it asks for an external product: a probability estimate, an argument map, a written explanation of assumptions, a comparison of rival hypotheses, a prediction log, or a worked solution with error notes. This gives the learner and coach something to inspect. The Ericsson tradition emphasises practice that targets a defined weakness, is effortful, and includes feedback and repeated attempts; later debates caution that deliberate practice is not the only source of expert performance, but the training design principle remains valuable for skills where performance can be measured and corrected.[PubMed+2PMC]pubmed.ncbi.nlm.nih.govDeliberate practice and acquisition of expert performanceby KA Ericsson · 2008 · Cited by 2927 — DP also involves the provision of…

A useful example comes from science education. In work on teaching quantitative critical thinking in physics labs, students were repeatedly asked to make decisions based on data, compare datasets with models, and improve methods in response to evidence. After the prompts were gradually withdrawn, students in the experimental condition were far more likely than students in traditional labs to spontaneously improve experimental methods and explain limitations in a physical model. The important point is not that physics labs are the only route to better reasoning; it is that the course made the target reasoning move visible, practised it repeatedly, and faded support only after students had internalised the move.[arXiv]arxiv.orgarXiv Teaching Critical ThinkingarXiv Teaching Critical Thinking

The same logic applies outside classrooms. A person trying to improve judgement should not merely “read more about bias”. They should choose one reasoning behaviour at a time: estimating uncertainty, distinguishing evidence from interpretation, identifying the weakest premise, generating alternative explanations, or updating a belief after new information. Then they need a task where success and failure can be seen.

Reasoning subskills to train

Deliberate practice works best when “better thinking” is broken into components. Critical thinking is often described as purposeful, self-regulated judgement involving interpretation, analysis, evaluation, inference and explanation. That definition is helpful because each part can become a practice target rather than an abstract virtue.[PMC]pmc.ncbi.nlm.nih.govOpen source on nih.gov.

Argument reconstruction is one of the most trainable subskills. A learner takes a short article, memo, speech or essay and identifies the main conclusion, supporting reasons, hidden assumptions and objections. Argument mapping makes this visual, using boxes and arrows to show how claims depend on one another. Studies and reviews of argument mapping suggest that it can improve critical thinking because it forces the structure of reasoning into the open: a weak link can no longer hide inside polished prose.[ThinkerU+2Springer Nature Link]thinkeru.orgOpen source on thinkeru.org.

Evidence evaluation is another core target. The practical task is to ask what kind of evidence would actually support the claim. A correlation, anecdote, expert opinion, controlled study and base-rate statistic do not carry the same weight. Deliberate practice here might involve ranking evidence quality, spotting missing comparison groups, or rewriting a claim so it matches the strength of the evidence.

Alternative-generation trains the habit of asking, “What else could explain this?” This is especially important when a first explanation feels obvious. A person may assume a colleague is careless when the real cause is unclear instructions, workload, incentives or missing tools. Practising rival explanations reduces the chance that confidence attaches too quickly to the first plausible story.

Calibration is the skill of matching confidence to accuracy. Instead of saying “I’m sure”, the learner gives a probability or confidence interval, later checks the outcome, and adjusts. Forecasting tournaments and calibration exercises are valuable because they create repeated, scoreable judgements. The Good Judgment Project became influential precisely because it treated forecasting as a trainable judgement skill, combining probability training, practice, feedback, updating and aggregation.[AI Impacts]aiimpacts.orgOpen source on aiimpacts.org.

Error diagnosis turns mistakes into material for improvement. The question is not just “Was I wrong?” but “What kind of wrong was this?” Common categories include misread evidence, ignored base rates, vague definitions, motivated interpretation, poor numeracy, overconfidence, and failure to consider alternatives. A short error log can reveal that a person’s recurring weakness is not “bad thinking” in general but, for example, jumping from anecdotes to general claims.

Why feedback has to be specific

Feedback is the difference between practice and repetition. But not all feedback is useful. “Good argument”, “weak analysis” or “be more critical” gives too little information to change behaviour. Deliberate practice needs feedback that points to the move that failed and what a better move would look like.

In critical-thinking instruction, broad exposure is less reliable than explicit teaching plus practice. A major meta-analysis of critical-thinking interventions found positive average effects, but also substantial variation across studies, which is exactly what one would expect if “critical thinking” courses differ in whether they teach skills directly, require practice, and provide feedback.[Sage Journals]journals.sagepub.comFirst, the evidence on…Read more…

Argument mapping shows why specificity matters. A learner can be told that an essay is unconvincing and still not know what to do. But if a map shows that the conclusion rests on an unsupported assumption, or that a reason supports a different conclusion from the one claimed, the learner can revise a precise part of the reasoning. That is closer to how a musician corrects a phrase or a chess player reviews a tactical mistake: the error is local enough to practise.

Feedback also needs a credible standard. In many reasoning tasks, there is no single answer key, but there can still be standards: whether the conclusion follows from the premises, whether alternative explanations were considered, whether a forecast was scored correctly, whether a probability estimate was calibrated, whether a source actually supports the claim made from it, or whether a decision memo separates facts from interpretations.

A useful feedback loop has four parts:

The loop matters because people are often poor judges of their own thinking quality. Research on intuitive expertise argues that subjective confidence is not enough; reliable intuition requires a sufficiently regular environment and enough opportunity to learn from valid cues. Where feedback is weak or the environment is noisy, experience can create confidence without accuracy.[ResearchGate]researchgate.netResearch Gate(PDF) Conditions for Intuitive ExpertiseResearch Gate(PDF) Conditions for Intuitive Expertise

Practice tasks that make reasoning visible

The most useful exercises are not motivational rituals. They are small, repeatable tasks that expose the quality of a specific reasoning move.

A strong routine for everyday analytical practice is the prediction journal. Before a decision, event or claim resolves, write a probability and a brief rationale. Later, record the result and ask what should change. This trains calibration, base-rate use and belief updating. Forecasting research is attractive for reasoning practice because it gives unusually clean feedback: the forecast either resolves or it does not, and scoring rules can reward both accuracy and appropriate uncertainty.[AI Impacts]aiimpacts.orgOpen source on aiimpacts.org.

Another routine is the argument map. Take a short opinion piece or workplace recommendation and identify the main conclusion, reasons, objections and assumptions. Then test whether each reason genuinely supports the conclusion. This is especially helpful for people who are verbally fluent but tend to lose track of structure. Argument mapping’s value is not that diagrams are magical; it is that diagrams reduce the hiding places for vague inference.[ThinkerU]thinkeru.orgOpen source on thinkeru.org.

A third routine is the rival-explanation drill. For any diagnosis, interpretation or plan, generate at least three alternative explanations before choosing one. Then list what evidence would distinguish them. This trains resistance to premature closure: the common failure where the first plausible explanation becomes the only one seriously tested.

A fourth routine is the confidence check. After answering questions or making judgements, rate confidence before seeing the answer. Over time, compare confidence bands with accuracy. If claims made at 90% confidence are right only 60% of the time, the issue is not simply knowledge; it is miscalibration. Research on calibration training in intelligence analysts suggests that training can affect confidence, though effects may differ by task and may sometimes shift bias towards lower confidence rather than improving metacognitive monitoring across the board. That caution is useful: calibration practice should be scored and reviewed, not assumed to work because it feels humbling.[ResearchGate]researchgate.netOpen source on researchgate.net.

A fifth routine is the post-mortem of reasoning, not just outcome. After a decision, review the quality of the reasoning separately from the result. A good decision can have a bad outcome, and a bad decision can get lucky. The review should ask: What did I know at the time? What did I ignore? Which assumption carried the most weight? What would I do differently next time?

The adjustment loop is the intervention

For deliberate practice in reasoning, the policy or implementation challenge is not persuading people to think harder. It is designing environments where better thinking is easier to practise and poor thinking is harder to repeat unnoticed.

In schools and universities, this means moving beyond assignments that reward final answers only. Students need tasks where reasoning steps are submitted, marked and revised. A science lab can require students to compare data with models. A history course can require source reliability judgements. A philosophy or politics course can require argument maps. A statistics course can require confidence estimates and later calibration. The shared design principle is that the thinking process leaves a trace.

In workplaces, the same idea can be built into decision routines. A hiring panel can require written criteria before seeing candidates. A product team can record predictions about user behaviour before launch. A policy team can separate “what we know”, “what we infer” and “what would change our mind”. A leadership group can review not only whether a plan succeeded but whether the original reasoning relied on weak evidence or ignored plausible risks.

The most important design choice is the feedback source. Different reasoning subskills need different feedback:

Reasoning targetUseful practice productBest feedback sourceCalibrationForecasts, confidence intervals, probability estimatesOutcome scoring over timeArgument structureArgument maps, written reconstructionsExpert or peer review against clear criteriaEvidence qualitySource evaluations, claim-evidence tablesRubrics, methodological standards, fact checksAlternative explanationsDiagnostic notes, rival hypothesesComparison with later evidence or expert critiqueBias reductionPre-commitments, decision checklists, case analysesError review, outcome review, structured challenge

Debiasing research supports this implementation focus. Morewedge and colleagues found that one-shot debiasing interventions, including a computer game and instructional video, could reduce several biases over time, with evidence of transfer beyond the exact taught problems. But the stronger lesson is not that a single lesson solves bias permanently. It is that bias reduction improves when people practise recognising bias patterns, receive corrective information, and apply strategies to new cases.[City Research Online]openaccess.city.ac.ukCity Research Online Debiasing DecisionsImproved Decision Making With A…by CK Morewedge · 2015 · Cited by 595 — We report the results of two longitudinal experiments that fou…

Where deliberate practice can fail

Deliberate practice is powerful, but it is easy to oversell. The strongest critique is that not every domain gives clean, immediate, reliable feedback. Chess, music and some sports provide relatively clear performance signals. Many real-life judgement domains do not. A business strategy can look good for years before failing. A political forecast may depend on rare events. A medical diagnosis may be confounded by incomplete follow-up. A social judgement may never receive honest correction.

This is why deliberate practice for reasoning should avoid pretending that all thinking can be trained like scales on a piano. The practice design has to create artificial clarity where the real world is murky: shorter cases, answerable questions, scored forecasts, well-defined rubrics, expert comparisons, and repeated tasks of the same type. Otherwise the learner may simply rehearse effort without learning.

There is also a risk of training narrow tricks. Someone may become good at spotting textbook fallacies but still reason poorly about messy evidence. Someone may learn to lower confidence estimates without becoming more accurate. Someone may use a checklist performatively while still defending the conclusion they wanted all along. The 2024 study of calibration training in intelligence analysts is a useful warning here: improvement can be task-dependent, and shifts in confidence are not automatically the same as better monitoring.[ResearchGate]researchgate.netOpen source on researchgate.net.

The broader deliberate-practice literature also warns against simple hour-count stories. Reviews and critiques argue that practice matters, but it does not explain all variation in expertise, and the definition of deliberate practice has sometimes shifted across debates. For reasoning skills, that means the practical claim should be modest and strong: targeted, feedback-rich practice is one of the best available ways to improve specific judgement behaviours, not a guarantee of general wisdom.[PMC+2Frontiers]pmc.ncbi.nlm.nih.govOpen source on nih.gov.

A practical way to train better judgement

A workable reasoning-practice programme can be small. It does not need to begin with a grand curriculum. It needs repetition, feedback and adjustment.

Start with one recurring decision type: evaluating news claims, making project estimates, diagnosing work problems, interpreting data, choosing between options, or forecasting outcomes. Then choose one reasoning subskill that is visibly weak. If the problem is overconfidence, use probability estimates and scoring. If the problem is muddled debate, use argument mapping. If the problem is rushing to a diagnosis, use rival explanations. If the problem is poor evidence standards, use claim-evidence tables.

The training cycle should be short enough to repeat:

The point is to build a library of corrected experiences. Years of unexamined experience can preserve bad habits because the mind remembers fluency, confidence and occasional success. Deliberate practice interrupts that loop. It gives the thinker a harder but more useful record: where the judgement failed, what a better move looked like, and what to practise next.

Why this belongs at the centre of better thinking

The practical value of deliberate practice is that it turns “improve your thinking” from a slogan into an intervention. It does not ask people to become perfectly rational. It asks them to improve particular reasoning moves under conditions where errors can be seen.

That is why deliberate practice sits between education, decision science and everyday self-improvement. Critical-thinking research shows that explicit instruction and practice can help, but effects vary depending on design. Argument mapping shows that making structure visible can improve analysis. Forecasting tournaments show that probabilistic judgement can be trained and scored. Debiasing studies show that some reasoning errors can be reduced through targeted intervention, while calibration research reminds us that feedback must be measured carefully. City Research Online+3Sage Journals+3eprints.teachingandlearning.ie[journals.sagepub.com]journals.sagepub.comFirst, the evidence on…Read more…

The durable lesson is simple: better judgement is not the automatic reward for having more opinions, more years at work, or more exposure to complex problems. It comes from repeatedly practising the parts of reasoning that usually remain invisible, then correcting them before they harden into style, identity or habit.

Amazon book picks

Further Reading

Books and field guides related to Why Experience Alone Does Not Fix Thinking. Use these as the next step if you want deeper reading beyond the article.

Book

Make It Stick

By Peter C. Brown, Henry L. Roediger III et al.

Explains evidence-based learning strategies that reinforce deliberate practice and skill acquisition.

See on Amazon

Book

Thinking, Fast and Slow

By Daniel Kahneman

Provides the cognitive foundations for understanding persistent thinking errors that deliberate practice aims to reduce.

See on Amazon

Book

The Art of Learning

By Josh Waitzkin

Illustrates how structured reflection, feedback, and focused practice produce sustained improvement in complex skills.

See on Amazon

Book

Superforecasting

By Philip Tetlock, Dan Gardner

The international bestseller 'A manual for thinking clearly in an uncertain world. Read it.' Daniel Kahneman, author of Thinking, Fast an...

See on Amazon

Browse more on Amazon: Make It Stick Thinking, Fast and Slow The Art of Learning

As an Amazon Associate I earn from qualifying purchases.

eBay marketplace picks

Marketplace Samples

Live-tested eBay searches with available results related to this page.

Shop location

UsingUSA USA USAUKCanadaAustraliaIreland

Top pick

critical thinking card game

Open a targeted eBay search for items related to this topic.

CriticalThinkingCard

Browse eBay

Related search

critical thinking game

Open a targeted eBay search for items related to this topic.

CriticalThinkingGame

Browse eBay

Related search

alone poster

Open a targeted eBay search for items related to this topic.

AlonePoster

Browse eBay

Related search

alone memorabilia

Open a targeted eBay search for items related to this topic.

AloneMemorabilia

Browse eBay

Browse more on eBay

Example items shown for inspiration; availability and pricing can change. Branchoria may earn a commission if you purchase through outbound eBay links.

Endnotes

1. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC7461852/

2. Source: arxiv.org
Title: arXiv Teaching Critical Thinking
Link:https://arxiv.org/abs/1508.04870

3. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC10300824/

4. Source: thinkeru.org
Link:https://thinkeru.org/wp-content/uploads/2018/09/TvG-Using-argument-mapping-to-improve-critical-thinking-skills-2015.pdf

5. Source: link.springer.com
Link:https://link.springer.com/chapter/10.1057/9781137378057_12

6. Source: eprints.teachingandlearning.ie
Link:https://eprints.teachingandlearning.ie/4010/1/Dwyer%20et%20al%202011%20THE%20PROMOTION%20OF%20CRITICAL%20THINKING%20SKILLS%20THROUGH%20ARGUMENT%20MAPPING.pdf

7. Source: researchgate.net
Title: Research Gate(PDF) Conditions for Intuitive Expertise
Link:https://www.researchgate.net/publication/26798603_Conditions_for_Intuitive_Expertise

8. Source: researchgate.net
Link:https://www.researchgate.net/publication/383853185_The_effect_of_calibration_training_on_the_calibration_of_intelligence_analysts%27_judgments

9. Source: researchgate.net
Link:https://www.researchgate.net/publication/281206303_Debiasing_Decisions_Improved_Decision_Making_With_a_Single_Training_Intervention

10. Source: researchgate.net
Link:https://www.researchgate.net/publication/347362903_Evaluating_instructional_labs%27_use_of_deliberate_practice_to_teach_critical_thinking_skills

11. Source: researchgate.net
Title: 304805904 Using Argument Mapping to Improve Critical Thinking Skills
Link:https://www.researchgate.net/publication/304805904_Using_Argument_Mapping_to_Improve_Critical_Thinking_Skills

12. Source: researchgate.net
Title: 281952187 Strategies for Teaching Students to Think Critically A Meta Analysis
Link:https://www.researchgate.net/publication/281952187_Strategies_for_Teaching_Students_to_Think_Critically_A_Meta-Analysis

13. Source: researchgate.net
Link:https://www.researchgate.net/publication/249797930_Instructional_Interventions_Affecting_Critical_Thinking_Skills_and_Dispositions_A_Stage_1_Meta-Analysis

14. Source: researchgate.net
Link:https://www.researchgate.net/publication/353050662_Deliberate_Practice_the_High_Road_to_Expertise

15. Source: link.springer.com
Link:https://link.springer.com/article/10.1007/s12144-021-02326-x

16. Source: link.springer.com
Link:https://link.springer.com/article/10.3758/BF03205299

17. Source: pubmed.ncbi.nlm.nih.gov
Link:https://pubmed.ncbi.nlm.nih.gov/18778378/

18. Source: frontiersin.org
Link:https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2019.02396/full

19. Source: journals.sagepub.com
Link:https://journals.sagepub.com/doi/10.3102/0034654314551063

20. Source: openaccess.city.ac.uk
Title: City Research Online Debiasing Decisions
Link:https://openaccess.city.ac.uk/id/eprint/12324/

21. Source: aiimpacts.org
Link:https://aiimpacts.org/evidence-on-good-forecasting-practices-from-the-good-judgment-project/

22. Source: journals.sagepub.com
Link:https://journals.sagepub.com/doi/abs/10.3102/0034654314551063

23. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC10672018/

24. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC6460682/

25. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC8734377/

26. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC11616299/

27. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC3786644/

28. Source: pubmed.ncbi.nlm.nih.gov
Link:https://pubmed.ncbi.nlm.nih.gov/9479747/

29. Source: pmc.ncbi.nlm.nih.gov
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC7333631/

30. Source: journals.sagepub.com
Link:https://journals.sagepub.com/doi/10.1177/01492063241287188

31. Source: Wikipedia
Title: The Good Judgment Project
Link:https://en.wikipedia.org/wiki/The_Good_Judgment_Project

32. Source: structural-learning.com
Title: deliberate practice
Link:https://www.structural-learning.com/post/deliberate-practice

Additional References

33. Source: youtube.com
Title: Charting the Thicket: Using Argument Mapping to Explore Controversial Topics
Link:https://www.youtube.com/watch?v=f833pHMlJjk

34. Source: oecd.org
Link:https://www.oecd.org/content/dam/oecd/en/topics/policy-issues/future-of-education-and-skills/learning-compass-constructs/ReflectiveThinking.pdf

35. Source: youtube.com
Title: Improve Your Critical Thinking With This Framework
Link:https://www.youtube.com/watch?v=01_kyKpfM20

36. Source: youtube.com
Title: Argument Mapping: Understanding and Making Arguments w/ Nate Otey
Link:https://www.youtube.com/watch?v=kGgLlip_lvc

37. Source: youtube.com
Title: The Easiest Way to Improve Critical Thinking
Link:https://www.youtube.com/watch?v=TNbWpmgDcr4

38. Source: clinica.ispa.pt
Link:https://clinica.ispa.pt/sites/default/files/3_-_the_role_of_intuition_and_deliberative_thinking_in_experts_superior_tactical_decision-making.pdf

39. Source: reasoninglab.com
Link:https://www.reasoninglab.com/research-on-critical-thinking-argument-mapping/

40. Source: facebook.com
Link:https://www.facebook.com/groups/RutgersBlkAlumni/posts/10163407917223520/

41. Source: goodjudgment.com
Link:https://goodjudgment.com/services/training/

42. Source: hhs.purdue.edu
Link:https://hhs.purdue.edu/skill-learning-and-performance-lab/wp-content/uploads/sites/43/2024/08/Macnamara-et-al.-2018-Chapter.pdf