Skip to main content
AI Safety, Alignment & Ethics

⏱ About 15 min15 XP

What Is Bias?

Imagine a coin that lands heads 70 percent of the time. You would say that coin is biased — it does not give both sides an equal chance. Now imagine a hiring system that rates identical resumes differently depending on the name at the top. The system is biased in the same way: it tilts unfairly toward or against people based on something that should not affect the decision. In this lesson, you will learn exactly what bias means, why it matters, and how to spot it.

Bias in Everyday Life

Bias is not a strange, rare thing. It shows up everywhere humans make judgments — in which students teachers call on most often, in which neighborhoods get more police patrols, in which job candidates get callbacks. Bias means a systematic tilt: a pattern that consistently favors or disfavors a group in a way that is not justified by anything fair or relevant. The key word is systematic. A single mistake is not bias. Bias is a repeating, predictable pattern. If a teacher consistently calls on students in the front row and rarely on students in the back, that is a biased pattern — even if no individual decision felt unfair.

Bias Defined

Bias is a systematic tilt — a consistent, repeating pattern that favors or disfavors a group in a way that is not justified by relevant facts.

Bias can come from many sources. It can come from explicit prejudice — someone who consciously dislikes a group. But most bias in complex systems is subtler. It comes from assumptions baked into rules, from historical patterns treated as natural, or from data that reflects an unequal world. This subtler kind of bias is especially important for understanding AI.

Relevant vs. Irrelevant Attributes

When we say a tilt is unfair, we mean it is based on an attribute that should not affect the decision. The key question to ask is: is this characteristic relevant to what we are actually trying to measure or decide? A bank deciding whether to approve a loan should look at an applicant's income, debt, and credit history — those are relevant. It should not look at the applicant's race or gender — those are irrelevant to creditworthiness. If the bank's system gives worse scores to applicants of a certain race, even when their finances are identical to someone else's, that is bias. This distinction — relevant vs. irrelevant attribute — is the core of almost every fairness argument you will ever encounter.

The Relevance Test

Ask: 'Should this characteristic actually affect this decision?' If yes, using it might be fair. If no, using it is a red flag for bias.

Match each term to its best definition.

Terms

Bias
Relevant attribute
Irrelevant attribute
Systematic pattern
Explicit prejudice

Definitions

A repeating, predictable outcome rather than a one-time mistake
A characteristic that legitimately should affect a decision
A conscious, intentional dislike of a group that shapes decisions
A systematic tilt that consistently favors or disfavors a group
A characteristic that should not affect a decision but sometimes does

Drag terms onto their definitions, or click a term then click a definition to match.

Why Bias in AI Is a Serious Problem

AI systems are being used for high-stakes decisions: whether you get a job interview, whether you are approved for a loan, how likely a judge thinks you are to re-offend, whether a medical scan flags a disease in your body. When an AI system has bias, those biased outcomes scale up enormously — a biased algorithm applied to millions of people produces millions of biased outcomes. This is different from a single biased person making a single bad call. A biased human hiring manager might affect dozens of candidates a year. A biased AI hiring filter might affect millions of applications in the same period.

Scale Amplifies Harm

Bias in a human decision affects one person at a time. Bias in an AI system can affect millions of people simultaneously and consistently, magnifying the harm.

Which of the following best describes bias?

A resume-screening AI gives lower scores to identical resumes when the name at the top sounds like it comes from a particular ethnic group. Which word best describes this?

Bias or Not?

  1. Step 1: Read each scenario below and decide: is this bias? If yes, identify what group is being tilted against and whether the attribute used is relevant or irrelevant.
  2. A) A university admits students with higher math scores for a math degree program.
  3. B) A facial recognition system is significantly less accurate for people with darker skin tones.
  4. C) A streaming service recommends action movies to users who previously watched action movies.
  5. D) A loan algorithm gives lower credit scores to applicants from zip codes with historically lower incomes, regardless of those applicants' actual financial records.
  6. Step 2: For each scenario you labeled as bias, explain in one sentence what would make the system fairer.
  7. Step 3: Write your own definition of bias in your own words — no looking back at the lesson.