Apple seeds VisionKit AI SDK for spatial UI prototyping on Vision Pro

Design · 5 min read

VisionKit AI can generate 3D UI components, recommend placement based on ergonomic zones, and suggest motion behaviors that reduce visual discomfort. It outputs editable scene graphs and interaction bindings compatible with the Vision OS runtime.

The SDK also offers simulated user testing scenarios, enabling designers to preview how users might focus on and interact with spatial UI across different body heights and seating positions. Apple included tooling to annotate accessibility considerations like readable text sizes and reachable controls.

The beta is available to enrolled developers and designers. Apple stressed that created assets should be validated with real user testing in spatial environments and provided guidelines on comfort and motion best practices.