Runway launches Realtime UI Generator for game HUDs and overlays

Gaming · 4 min read

Runway's new Realtime UI Generator targets game designers and HUD artists, letting them produce layout proposals, icon sets, and animated overlays that can be previewed in-engine. The generator accepts gameplay telemetry and contextual rules so UIs adapt to player state, screen real estate, and performance budgets. Runway provides plugins for Unity and Unreal that stream assets into scenes with proper anchor points and scaling settings.

The model is trained on proprietary and open datasets of game interfaces, emphasizing ergonomics for controller and touch input. Outputs include vector icon packs and frame-based animations, and designers can instruct the system to respect platform-specific constraints like safe areas or leaderboard overlays. Runway also added optimization passes to reduce draw calls and texture memory for generated assets.

Game developers praised the speed of generating multiple HUD iterations, but also cautioned about aesthetic consistency across levels. Runway plans template and theme locking for production pipelines and deeper telemetry-driven adaptation to ensure UIs remain coherent during live events.