Expert Analyst Quality At Interactive Speeds
As contact center managers increasingly demand near instant insights for operational decisions across unpredictable scenarios, Observe.AI decided to build a service called AskObserve - a conversational intelligence platform that enables unconstrained exploration of contact center transcripts and data at uncompromising levels of accuracy. AskObserve is a strategic initiative for Observe’s Chief Product Officer, Vache Moroyan and is led by Sarika Kumari, a lead Product Manager in the team. To deliver the solution to some of the largest companies in their respective industries, Observe.AI was seeking to address the systemic challenges of traditional BI based solutions outlined below
- Analyst dependence slows business impact: Given the high accuracy requirement, important analyses currently need to be run by data analysts who understand the data models . However, given the small size of these teams, it creates a bottleneck "By the time you get these insights, it's like a week or so, making them practically not useful," Sarika explains
- Scarcity of analyst bandwidth makes insights inaccessible for operational decisions: Given the demand on analysts, access to them was limited to specialist teams, not the operations managers who needed to make daily decisions. However, running a Contact Center efficiently requires continuous adaptation and optimization
- Pre-created dashboards do not offer necessary degrees of freedom in exploration: While dashboards are available in plenty to seemingly fill the gap, they fail when a problem needs exploration that does not fit the confines of a dashboard. As Sarika Kumari points out, "They'll share a report, then you will again send back a mail saying, hey, these are my follow up questions"
The business consequences of these inefficiencies were noticeable. For example, common tasks such as Agent coaching required synthesizing data from multiple dashboards, taking 20-30 minutes per agent just to understand performance patterns. What was needed is a product that meets the accuracy bar of an expert analyst without any of the bottlenecks of a human centric operation.
The technical challenges that needed to be addressed to realize such a system were significant. Building a conversational analytics product that could interpret problems stated as arbitrary natural language questions using business jargon, figure out a solution plan and generate accurate SQL queries is really difficult. Sarika recognized that generic AI tools wouldn't solve this structured data challenge: "Converting natural language questions into accurate SQL queries isn't something you can solve by simply using standard LLMs with your data—it requires specialized expertise and an intense focus on the experience."