Midnight Studio Releases 'Pose2UI' — From Motion Capture to Interface States

Design · 4 min read

Pose2UI ingests motion or webcam-based skeletal data and maps gestures to UI states like swipe, pinch, or reach. Designers can define threshold profiles and see simulated UI responses in real-time, reducing guesswork when building gesture-first experiences.

The product includes an export format compatible with React Native and web animation libraries so prototypes can be quickly turned into working code. It also offers a testing mode to evaluate gesture recognition reliability across diverse body types and cameras.

Accessibility advocates welcome the testing features, but they urge careful inclusive design practices to avoid excluding users with limited mobility. Midnight Studio says they’ll add presets for alternative input methods in future updates.