Mistake Hunter
You have learned so much about AI and mistakes. You know that AI can get things wrong, you know why, and you know how to check. Now it is time to put on your detective hat and practice those skills for real. In this lesson, you are a Mistake Hunter. Your job is to read AI-style answers, find the mistakes hiding inside them, and figure out why each mistake might have happened. Mistake Hunters are not trying to be mean to AI. They are just doing an important job: making sure that information is accurate before it gets used.
Your Mistake Hunter Toolkit
Every good detective has tools. Here are the three tools in your Mistake Hunter Toolkit. Tool One: The Surprise Sensor. When you read an answer, ask yourself: does anything here seem surprising or different from what I know? Surprises are clues to check. Tool Two: The Specific Details Checker. Specific facts — names, dates, numbers, titles — are the most likely things AI gets wrong. Whenever you see something very specific, that is a flag to check. Tool Three: The Source Finder. Once you spot a possible mistake, find a trusted source to confirm or correct it. A dictionary, encyclopedia, atlas, or trusted website can be your partner. With these three tools, you are ready to hunt!
Mistake Hunters do not assume AI is wrong. They stay curious and alert, checking specific facts and anything that seems surprising. Finding a mistake is a success — it means you did your job!
Mistake Hunter Investigation
- Below are four short AI-style answers. Read each one carefully, then do the investigation.
- Answer 1: The tallest mountain in the world is Mount Everest, located on the border between Nepal and China. It is 29,032 feet tall. It was first summited in 1953 by Edmund Hillary and Tenzing Norgay.
- Answer 2: Butterflies go through four life stages: egg, caterpillar, chrysalis, and adult. They live for about two to three weeks on average, though some species like the monarch butterfly can live for up to 9 months during migration.
- Answer 3: The Great Wall of China was built entirely by Emperor Qin Shi Huang in the year 221 BCE. It stretches exactly 5,000 miles from one end to the other and can be seen from the moon with the naked eye.
- Answer 4: There are eight planets in our solar system: Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune. The largest planet is Jupiter, and the smallest is Mercury.
- For EACH answer, do three things:
- 1. Circle or write down any facts that seem specific enough to check.
- 2. Rate your suspicion level: is this answer mostly right, partly wrong, or has some big mistakes?
- 3. Choose one specific fact from each answer to look up in a trusted source. Write what you find.
- When you are done, come back and compare: which answers had real mistakes? What were they? What made them easy or hard to spot?
- Bonus challenge: Which of the four answers is entirely correct? Which one has the most mistakes? How many distinct errors can you find across all four answers combined?
After you have done your investigation, let us talk through what a careful Mistake Hunter would notice. For Answer 3 about the Great Wall: a careful hunter would notice some specific claims that deserve checking. The Great Wall was not built entirely by one emperor — it was built and extended by many dynasties over many centuries. The claim that it can be seen from the moon with the naked eye is actually a famous myth: astronauts have reported that it is too thin to see from that distance. And the length is debated by historians — different measurement methods give different results. A Mistake Hunter spotted those because they used their Surprise Sensor (the moon claim sounds surprising) and their Specific Details Checker (exact measurements and dates are flagged for checking). Notice: the hunter did not throw away the whole answer. They kept the parts that are correct — there really is a Great Wall, it is really in China, Qin Shi Huang really was an important builder — and they corrected or flagged the parts that needed work. That is exactly what a smart AI user does.
When you find a mistake in an AI answer, you do not have to throw away everything. Keep the accurate parts and correct the mistakes. That is better than starting from zero every time.
A Mistake Hunter reads that the Great Wall of China can be seen from the moon with the naked eye. What should they do?
After finding a mistake in an AI answer, what should a smart Mistake Hunter do?