Runway and Unity Demonstrate Real-Time Background Replacement for Game Streams Using Lightweight Models

Gaming · 3 min read

The demo uses a compact segmentation model optimized for low-latency insertion, allowing streamers to replace green-screens or messy rooms with in-game backgrounds that match camera perspective and lighting. The solution runs on consumer GPUs and is available as a plugin for Unity's live capture toolchain.

Runway highlighted that the model preserves fine details like hair and motion blur while producing artifact-free composites at 60 FPS on mid-range hardware. The offering is aimed at streamers and content creators wanting higher production value without expensive capture stages.

Both companies plan to release a beta SDK so developers can hook the feature into custom broadcast workflows. Streamers and production teams will still need to tune chroma and lighting for best results, but the model reduces reliance on physical green-screens.