How VR Headsets Actually Track Your Movement
The first time you put on a decent VR headset and physically duck under a virtual ledge, something clicks. The image moves exactly the way the real world would. There's no menu, no button — you just move, and the world holds still around you. That illusion is doing a lot of heavy lifting, and most of it comes down to one word: tracking.
Tracking is how the headset answers two questions, hundreds of times a second: where is your head, and where are your hands? Get the answer slightly wrong or slightly late, and the magic falls apart fast. Get it right, and you forget the hardware is even there.
3DoF vs 6DoF, and why it matters
You'll see two terms thrown around: 3DoF and 6DoF. They sound like jargon, but the difference is the whole ballgame.
3DoF (three degrees of freedom) tracks rotation only — you can look up, down, left and right, like turning your head while strapped into a chair. The cheap phone-based viewers from years ago were 3DoF. You could look around a scene, but if you leaned forward, the scene didn't react. Your brain notices, and not in a good way.
6DoF adds the three you actually care about: moving forward and back, side to side, and up and down. Now you can lean, crouch, and step around things. Every headset worth buying today is 6DoF, and it's the single biggest reason modern VR feels real instead of like a 3D screen taped to your face.
Inside-out: the cameras live on the headset
Older systems used "outside-in" tracking — you'd mount little boxes or base stations in the corners of your room, and they watched the headset. It worked beautifully but was a pain to set up and a pain to move.
Almost everything now uses inside-out tracking. The cameras are built into the headset itself, pointing outward at your room. The headset watches the world go by and works out how it must have moved to produce what the cameras see. It's the same trick your brain uses when you walk down a hallway: the walls slide past in a predictable way, and from that you know how fast you're moving.
The clever part is that the headset isn't tracking neat printed markers. It picks out hundreds of natural feature points — the corner of a picture frame, the edge of a bookshelf, a scuff on the wall — and follows them frame to frame. This is why a blank white room with no detail can actually confuse a headset: there's nothing for it to grab onto.
The sensor that fills in the gaps
Cameras are good but not fast enough on their own. So every headset also has an IMU — an inertial measurement unit, the same kind of accelerometer-and-gyroscope combo that's in your phone. The IMU reports motion thousands of times a second, far faster than the cameras can process an image.
The catch is that an IMU drifts. On its own it would slowly convince itself you'd wandered across the room when you hadn't. So the two systems work as a team: the IMU handles the fast, instant motion, and the cameras quietly correct the drift a few times a second. You never see the handoff. You just get motion that feels immediate and stays accurate.
Tracking your hands
The controllers are tracked the same way the headset is — the cameras spot them and follow them through space. Older controllers wore a ring of infrared LEDs to make themselves easy to see; newer designs have shrunk those rings or dropped them entirely in favour of computer vision that recognises the controller's shape.
Most headsets can also track your bare hands now, no controllers at all. It's genuinely useful for menus and casual apps, though it still struggles when your hands leave the cameras' view or when one hand hides behind the other. For anything needing precision or a trigger pull, controllers still win.
The boundary that keeps you from walking into a wall
Since the headset already understands your room, it lets you draw a boundary — a virtual fence around your safe space. Step toward the edge and a grid wall fades into view to warn you. It's not a gimmick; it's the difference between a fun session and a bruised shin. Redraw it whenever you move furniture around.
The short version
Modern VR tracking is really three systems pretending to be one: cameras that watch your room, a motion sensor that reacts instantly, and software that blends the two into a single believable picture of where you are. When it's working, you'll never think about any of it. That's the whole point.