Runway Canvas v3 adds experimental UI video-to-components conversion for designers

Design · 4 min read

Canvas v3's UI extraction pipeline analyzes screen recordings and segments buttons, inputs, dialogs and transitions, then outputs an editable prototype with layer structure, timings and suggested interaction triggers. The idea is to accelerate converting a product demo or moderated usability session into a working prototype.

Runway highlighted workflows where product managers or UX researchers can drop a recording into Canvas and get a starting point for redesign and iteration. Generated prototypes can be exported to standard formats compatible with Figma and Framer, or further edited inside Runway's own environment.

Runway cautioned that the feature is in beta and requires cleanup for complex overlays, custom controls, and platform-specific behaviors. The company is inviting designers to opt in to a feedback program to refine recognition accuracy and accessibility labeling.