Towards Reliable Conversational Data Analytics

Conversational AI systems for data analytics aim to enable the extraction of analytical insights by means of conversational interfaces. Such interfaces are powered by a mix of query modalities and machine learning methods for analytics, and are relying on Large Language Models (LLMs) for natural language generation. However, critical challenges hinder their adoption. The question we discuss is how to devise reliable Conversational Data Analytics (CDA) systems producing timely, consistent, and verifiable answers. To reach this goal, we identify five properties that impose a paradigm shift in the way systems are built and in the way they interact with users. To illustrate that shift, we describe a prototypical CDA system. We recognize two different approaches for building a reliable CDA: (1) by adding the required properties on top of existing components, or (2) by building components to provide such properties by design. Both approaches require overcoming important data management challenges and conducting an in-depth integration with advanced data management and machine learning techniques.