Apple opens VisionOS SDK 2.1 with spatial ML primitives for object persistence

AI · 5 min read

VisionOS SDK 2.1 introduces prebuilt spatial ML components that developers can use to identify, anchor, and persist virtual objects in physical environments across sessions. The primitives reduce the friction of building persistent AR experiences, handling occlusion, relocalization, and multi-user synchronization automatically.

Improved sensor fusion and new low-light algorithms enhance hand and finger tracking, which should reduce jitter and misrecognition in dim environments. Apple also added a set of accessibility affordances — haptic cues and spatial audio markers — to make AR experiences easier to navigate for users with visual impairments.

Apple says the SDK will enable more practical MR apps, from interior design tools that remember previous placements to educational apps that can return to a saved scene. Designers and developers noted that the new primitives will simplify cross-disciplinary workflows but cautioned that testing across varied physical spaces remains critical.