Google Maps Live View AR Teardown: Spatial UI and Onboarding for Wayfinding

Tech · 6 min read

Live View uses AR overlays to place directional arrows and street labels in the real world, relying on visual positioning service (VPS) and depth cues. The onboarding emphasizes short calibration steps and shows quick examples to teach users how to hold their phones and rotate for accurate localization.

Design challenges include managing occlusion when overlays cover critical real-world signage and maintaining legibility in bright sunlight. Google mitigates this with semi-transparent markers, anchoring arrows to ground planes, and fallback to traditional map views when VPS confidence is low.

The teardown suggests improvements: progressive AR affordances that start small and grow as VPS confidence increases, and more explicit messaging about when AR is unreliable. For spatial UI, graceful fallback and clear mental models are essential to build trust.