UX Case Study: Turning a B2B Analytics Dashboard from Power Tool to Conversational — and the Surprises That Followed

Tech · 6 min read

The dashboard had a steep learning curve: power users loved flexibility, but business users struggled to extract simple insights. The team introduced an optional conversational overlay powered by templates and guided prompts that translated natural language queries into prebuilt visualizations. Designers aimed to lower the entry barrier while preserving advanced configurability behind an expert mode.

Early testing showed business users could get quick answers without learning the full UI, and support tickets with 'how do I find' questions dropped by 27%. However, power users reported the overlay sometimes encouraged teammates to avoid learning advanced filters, which led to longer chains of 'ask a person' workflows and repeated simple requests. To counter that, the team added inline hints that surfaced equivalent advanced controls after users ran a few conversational queries.

The final product retained the conversational layer as a discoverability bridge, introduced progressive disclosure to teach users the underlying filters, and implemented analytics to surface which conversational prompts were most used. The integration improved onboarding for non-technical users while nudging teams toward higher-skill tasks, demonstrating that conversational UX is powerful for access but needs deliberate scaffolding to avoid creating permanent dependencies.