Apple updates CoreML 4 with on-device layout and typography models

Tech · 4 min read

CoreML 4 adds preoptimized neural networks that infer layout adjustments, font scaling, and contrast tweaks based on content and accessibility settings. These models enable apps to adapt UIs on-device, reducing latency and keeping user data private. Apple provided developer APIs that return concrete adjustment proposals and confidence scores so apps can choose conservative or aggressive transforms.

The new tooling supports continuous learning through local user feedback loops where allowed, and developers can opt into anonymized telemetry for aggregated improvements. CoreML 4 also includes export templates that convert popular design tokens into model-friendly formats, easing integration for mobile-first design teams.

Developers appreciated the on-device privacy model but asked for clearer guidance on when to prefer automated adjustments versus manual controls. Apple said official Human Interface Guidelines will be updated to include best practices for AI-driven layout choices and accessibility trade-offs.