Understanding the Observability Dashboard

The Observability dashboard gives you a real-time and historical view of every AI agent interaction across your product. It is designed for both product and ops teams - you can track aggregate performance metrics and drill down to individual conversation replays.

Key Metrics Explained

The top-level metrics on the dashboard are:

• Agent Activations - the total number of times any agent was triggered in the selected time period
• Containment Rate - the percentage of conversations resolved by the AI without human escalation
• Completion Rate - the percentage of users who completed the goal the agent was configured for (e.g., form submission, payment)
• Handoff Rate - the percentage of conversations escalated to a human agent
• Average Resolution Time - average time from agent activation to goal completion or handoff

The Conversation Explorer

The Conversation Explorer lets you replay individual agent sessions. You can filter sessions by outcome (completed, abandoned, escalated), by agent, by user segment, or by date. Each session replay shows the full message history, the behavioral signals that triggered the agent, and the outcome.

Drop-Off Analysis

The Drop-Off Analysis view shows where in the agent conversation flow users are most likely to disengage. Use this to identify specific messages or steps that need to be rewritten or restructured. This view is particularly valuable for onboarding and form-completion agents where every step matters.

Exporting Data

All dashboard data can be exported as CSV for further analysis. You can also connect the Observability API to your own BI tools (Tableau, Metabase, Looker) to build custom dashboards on top of RevRag AI data.