Sketch-to-Reality: Startups Release Models That Convert 2D Mockups into AR-Ready Components

Design · 5 min read

These models analyze flat mockups and infer depth layering, occlusion, and plausible interaction affordances, outputting assets compatible with AR platforms. Startups emphasize the speed advantage for exploratory prototyping when teams need to validate placement and scale in 3D.

Most solutions supply editable exports for popular AR frameworks and provide plugins for Figma and Adobe so designers can push prototypes into immersive viewers with minimal conversion work. Several vendors also offer collaborative review workflows for stakeholders to leave context-aware annotations in 3D.

Designers praise the ability to iterate quickly but caution that inferred depth and interaction are approximations that require manual adjustment for production. The companies plan to improve model robustness and add support for varied display form factors in subsequent releases.