Hugging Face releases Doodle2UI: sketch-to-component model with attention to accessibility

AI · 4 min read

Doodle2UI accepts low-fidelity sketches and generates vectorized, token-aware components with annotated accessibility metadata—labeling interactive elements, suggesting ARIA roles, and providing contrast adjustments. The model is packaged with community datasets and an inference API geared toward design-tool integrations.

Hugging Face prioritized explainability: outputs include a rationale for accessibility recommendations and a confidence score per annotation, enabling designers to quickly review and accept changes. The model also outputs a migration plan for converting rough sketches into component libraries with naming suggestions and token mappings.

The release is open-source and comes with example plugins for Figma and Penpot. Hugging Face recommends combining Doodle2UI with human review, particularly for semantic correctness and complex interaction scenarios, but points to strong early results in speeding up early-stage ideation into robust design assets.