How AR Works
In 2016, a game called Pokemon GO had millions of people walking around their neighborhoods pointing their phones at sidewalks and parks, catching cartoon creatures that seemed to be standing right there in the real world. Those creatures were never really there - the phone was using augmented reality, or AR, to draw them onto a live camera picture.
What You'll Learn
- What augmented reality means and how it is different from virtual reality - The three main parts a phone or device needs to make AR work - How a device figures out where to "place" a digital object in real space - Real examples of AR being used today outside of gaming
Augmented, Not Replaced
The word "augmented" means added to or made better. Augmented reality takes the real world you can already see through a camera and adds digital images on top of it. This is very different from virtual reality (VR), which replaces everything you see with a completely made-up digital world through a headset. In AR, you still see your actual room, street, or backyard - just with something extra layered in.
Three Parts That Make AR Work
An AR device needs three main parts working together. First, a camera captures a live video of the real world. Second, sensors - like the gyroscope and accelerometer already built into most phones - track exactly how the device is moving and tilting, dozens of times per second. Third, software analyzes the camera image to find flat surfaces, edges, and distances, then calculates exactly where a digital object should appear so it looks like it is really sitting on your table or floor. This process of finding surfaces and tracking position is called SLAM, which stands for Simultaneous Localization and Mapping. It is the same basic technology researchers first built for robots so they could map an unknown room while figuring out their own position inside it.
IKEA's shopping app uses AR to let customers place a life-size, to-scale digital couch or table in their actual living room through their phone camera before ever buying the real furniture.
AR Beyond Games
AR is used far beyond games and shopping. Surgeons use AR headsets that overlay a patient's scan data directly onto their body during real operations. Airplane mechanics use AR glasses that highlight exactly which bolt to turn next. Museum apps use AR to make ancient statues appear to move and speak on a visitor's phone screen.
What is the key difference between augmented reality and virtual reality?
What does SLAM technology help an AR device do?
Match each AR part to its job.
Terms
Definitions
Drag terms onto their definitions, or click a term then click a definition to match.
Design an AR App Concept
Choose a real problem AR could help solve (for example: assembling furniture, learning human anatomy, or navigating a new building). Sketch or describe on paper: (1) what the camera would see, (2) what digital object or information AR would add on top, and (3) why that would be more helpful than a plain instruction manual or map. Turn in your one-page concept sketch with labels.
Want to keep learning?
Sign up for free to access the full curriculum — all subjects, all ages.
Start Learning Free