Custom Dashboards

transform your llm application data into actionable insights with abv custom dashboards create personalized views that track the metrics that matter most to your team from latency and cost optimization to quality monitoring and user behavior analysis custom dashboards provide a flexible, self service analytics solution built on a powerful query engine that supports multi level aggregations across your tracing data https //docs abv dev/observability data model whether you're monitoring production performance, analyzing user feedback trends, or correlating costs with quality metrics, dashboards give you the visualization tools to make data driven decisions key capabilities flexible query engine built on the abv data model https //docs abv dev/observability data model with support for complex aggregations across traces, observations, users, sessions, and scores rich visualization options multiple chart types including line charts, bar charts, and time series with customizable layouts advanced filtering filter by metadata, timestamps, user properties, model parameters, and more multi level aggregations aggregate data at trace, user, or session levels to answer complex analytical questions real time updates dashboards reflect live data from your llm applications team collaboration share dashboards across your project for unified monitoring and insights abv curated dashboards a set of pre built dashboards focused on latency, cost, and abv usage to quickly get started quick start get started with custom dashboards in two simple steps or use abv's curated dashboards right away 1\) create your first widget widgets are individual visualization components that display specific metrics from your llm application data navigate to the dashboards section in your abv project select the widgets tab click new widget configure your widget data source choose from traces, observations, or evaluation scores metrics select what to measure (count, latency, cost, scores, etc ) dimensions group by user, model, time, trace name, etc filters narrow down to specific data subsets chart type pick the best visualization for your data click save to store your widget 2\) build your dashboard combine multiple widgets into comprehensive dashboards that tell the story of your llm application performance navigate to the dashboards tab click new dashboard give your dashboard a descriptive name (e g , "production monitoring", "cost analysis", "quality metrics") add widgets by selecting from your existing widgets or creating new ones arrange widgets using the drag and drop interface resize widgets to emphasize important metrics leverage curated dashboards jump start your analytics with abv curated dashboards that focus on common llm application monitoring needs latency dashboard monitor response times across models and user segments cost dashboard track token usage and associated costs over time usage dashboard understand your abv platform utilization these pre built dashboards can be used as is or cloned and customized to match your specific requirements advanced features advanced filtering and grouping create precise data views using abv's powerful filtering capabilities metadata filters filter by custom metadata attached to traces and observations time based filters analyze specific time periods or compare time ranges user properties segment by user characteristics and behavior patterns model parameters filter by specific model configurations or versions tags and labels use trace tags https //docs abv dev/tags for categorical filtering score thresholds filter by quality score ranges or feedback ratings chart types and visualization choose the right visualization for your data line charts perfect for tracking trends over time (latency, cost, usage) bar charts compare values across categories (models, users, features) time series monitor real time metrics with temporal granularity pie charts display proportions of categorical data (e g , feedback ratings) dynamic layout and responsiveness drag and drop interface easily rearrange widgets to create logical groupings responsive design dashboards adapt to different screen sizes and devices widget resizing emphasize important metrics with larger visualizations grid system maintain clean, organized layouts automatically data export and integration export your dashboard data for further analysis or integration with external tools see the export data https //docs abv dev/api and data platform overview guide for comprehensive export options including csv export of dashboard data integration with external analytics tools programmatic access via the metrics api https //docs abv dev/metrics api use cases and examples production monitoring dashboard monitor the health and performance of your llm application in real time error rate tracking monitor failed requests and error patterns latency analysis track p95 and p99 response times across different endpoints throughput monitoring visualize request volume and capacity utilization model performance compare accuracy and quality metrics across model versions tool usage & latency track how often each external tool (e g api calls, database queries) is invoked and its latency cost optimization dashboard understand and optimize your llm usage costs token usage trends track input/output token consumption over time cost per user identify high usage users and optimize pricing strategies model cost comparison compare costs across different llm providers and models feature cost analysis understand which application features drive the highest costs quality and user experience dashboard monitor the quality and user satisfaction of your llm application user feedback trends track thumbs up/down ratings and detailed feedback score distribution visualize the distribution of quality scores over time user behavior analysis understand how users interact with different features a/b test results compare quality metrics between different model versions or prompts