Reflective Decision-Making

A single decision, however well-reasoned, does not make a good decision-maker. Good judgment is built over time through a specific practice: deliberate reflection on past decisions — what was known, what was decided, what happened, and what can be learned. Most people skip this step entirely. They make decisions and move on, updating their beliefs implicitly and haphazardly, without ever examining the quality of their reasoning or separating good process from lucky outcomes. This lesson is about building the practice of reflective decision-making — converting your own experience into systematically improved judgment.

Why Reflection Is Hard

Reflective decision-making faces several psychological obstacles. Outcome bias: we judge past decisions by their outcomes rather than by the quality of reasoning available at the time. A decision that turned out well gets remembered as wise; a decision that turned out poorly gets remembered as foolish — regardless of whether the reasoning was actually better or worse. Hindsight bias: once we know how things turned out, the outcome feels like it was always more predictable than it actually was at the time of the decision. 'I knew it would fail' is almost always partially retrospective construction. Hindsight bias destroys the accuracy of your memory of your own uncertainty — making it hard to honestly evaluate what you knew when you decided. Self-serving attribution: successes tend to be attributed to our skill; failures tend to be attributed to bad luck or external factors. This is motivated reasoning — it protects self-esteem but prevents learning. The solution to all three is to record your decisions and your reasoning before outcomes are known. A decision journal — a written record made at the moment of decision — is the tool that makes accurate retrospection possible.

The Retrospective Protocol

Once an outcome is known, a structured retrospective extracts learning without falling into the traps described above. Step one: confirm what was actually decided and what the reasoning was at the time — using the decision journal entry, not memory. Step two: assess the process quality, independent of the outcome. Given only the information available when the decision was made, was the reasoning sound? Were the right options generated? Were key uncertainties identified? Were relevant biases avoided? A bad outcome from a sound process is a signal about the world's uncertainty — not a signal to change the process. A good outcome from a poor process is a warning that you got lucky — and you should fix the process before luck runs out. Step three: identify what new information the outcome reveals. What did you learn about the world that updates your future probability estimates? What patterns now seem more or less likely given what you observed? Step four: separate the skill component from the luck component. How much of the outcome was within your influence, and how much was outside it? Credit and blame should be assigned proportionally to influence. Step five: update your future decision approach. What specific, concrete change to your process — a new question to ask, a trap to watch for, a source to consult — follows from this retrospective?

Compounding Judgment Over Time

The most powerful benefit of a consistent reflection practice is compounding. Each decision retrospective generates a small update to your beliefs and your process. Over hundreds of decisions, these small updates accumulate into substantially improved judgment — better calibration, faster recognition of traps, richer pattern-matching from lived experience. Research on expert forecasters — the superforecasters studied by Philip Tetlock — shows exactly this pattern. The forecasters who achieved the best calibration over time were not those with the most domain knowledge or the highest IQ. They were those who most consistently reviewed their forecasts after outcomes were known, updated their beliefs in proportion to the evidence, and identified what in their reasoning had been off. They treated forecasting as a skill to be improved through deliberate practice, not a talent to be displayed. The same principle applies to any domain of judgment. You cannot control every outcome. You can control the quality of your process and the rigor of your learning. Over time, that is the entire game.