Rules and Governance of AI
Every powerful technology in history has eventually been governed by rules — about who can use it, how, and for what purposes. Cars need licenses, speed limits, and safety inspections. Food needs health standards. Banks need audits. The question for AI is not whether it will be governed, but who will govern it, what rules will apply, and whether those rules will actually protect people.
What AI Governance Means
AI governance refers to the rules, standards, practices, and oversight mechanisms that shape how AI is built and used. Governance can come from several sources. Legislation is laws passed by governments that set binding requirements. The EU AI Act is a landmark example — it categorizes AI uses by risk and imposes legal obligations. Regulation is rules created by government agencies that translate broad laws into specific requirements. In the United States, agencies like the Federal Trade Commission (FTC) can regulate AI used in advertising, lending, and consumer products under existing consumer protection laws. Industry standards are voluntary guidelines that companies adopt, sometimes to stay ahead of legislation and avoid stricter government rules. Groups like the Partnership on AI bring together companies, researchers, and civil society organizations to develop shared norms. Internal policies are rules companies set for themselves about what AI they will and will not build. Some companies have published lists of uses they refuse to support — like building facial recognition for mass surveillance or AI for weapons. International agreements are treaties and frameworks between countries, though these are at an early stage for AI.
Binding legislation is sometimes called hard law — it has teeth; companies must comply or face penalties. Voluntary guidelines and industry standards are called soft law — they express norms but rely on companies choosing to follow them. Most AI governance today is soft law, which means it only works if companies and institutions want it to.
What Makes AI Hard to Govern
AI presents unusual challenges for governance, several of which have no precedent in regulating other technologies. Pace mismatch: AI capabilities advance faster than legislatures can study them, draft laws, debate them, and pass them. By the time a law addresses one generation of AI, the technology has moved on. Technical complexity: Most lawmakers and regulators do not have deep technical expertise in machine learning. Understanding how a specific AI system works — let alone whether it is biased or unsafe — requires specialized knowledge that government bodies often lack. Border-crossing: An AI system can be built in one country, trained on data from a second, hosted in a third, and used by customers in dozens of others. National laws struggle to govern systems that operate globally. Black-box opacity: Many AI systems produce outputs whose reasoning is difficult to explain even to engineers who built them. Governing something you cannot fully observe or explain is fundamentally challenging. Conflicting interests: Companies that profit from AI have incentives to lobby against regulations that would limit their products. This creates an imbalance of influence in the governance process.
When the industry being regulated gains excessive influence over the regulators, it is called regulatory capture. If only AI companies have the technical expertise to advise AI regulators, those regulators may end up writing rules that favor industry interests over public interests. Solving this requires investing in independent technical expertise in government.
Approaches That Show Promise
Despite the challenges, several governance approaches have shown real promise. Risk-based regulation — as in the EU AI Act — focuses the strictest rules on the highest-stakes AI applications, like those making decisions about employment, healthcare, or criminal justice, rather than applying the same rules to all AI. Algorithmic auditing allows independent experts to examine AI systems for bias, errors, and compliance with rules, similar to how financial audits work. Requirements for transparency and explanation mandate that organizations using AI in high-stakes decisions explain the basis for those decisions to affected individuals. AI safety institutes — government bodies dedicated to evaluating advanced AI — have been established in the United States, United Kingdom, and other countries to build independent expertise. Civil society participation means including researchers, affected communities, and advocacy organizations in drafting AI rules, not just companies and government officials.
Match each governance concept to its correct description.
Terms
Definitions
Drag terms onto their definitions, or click a term then click a definition to match.
What does the term 'pace mismatch' mean in the context of AI governance?
Why does risk-based regulation — like that in the EU AI Act — apply stricter rules to some AI uses than others?
Design an AI Rule
- Step 1: Choose one specific AI application — a hiring algorithm, a facial recognition system used by police, an AI that makes healthcare recommendations, or a social media recommendation engine.
- Step 2: Identify the three most significant harms this AI could cause if it went wrong or was misused.
- Step 3: Draft one specific rule that a government or company should follow when using this AI. Your rule should address at least one of the harms you identified.
- Step 4: Explain who would enforce your rule, what the penalty for breaking it would be, and how compliance would be verified.
- Step 5: Anticipate one objection from a company that wants to use this AI without your rule. Write a response to that objection.