Gain actionable insights into your LLM app's performance with ABV Metrics.  Monitor quality, cost, and latency using customizable dashboards and our powerful Metrics API.

Metrics overview

Create custom dashboards in ABV to turn LLM data into actionable insights.  Track key metrics like latency, cost, and quality with flexible widgets, advanced filtering, and rich visualizations to make data-driven decisions.

Custom Dashboards

Use the ABV Metrics API to build custom reports for your LLM app.  Programmatically query trace, observation, and score data with powerful filters and aggregations.

Metrics API

Cookbook: ABV JS/TS SDK

Metrics

Trace

ABV Developer Docs

Quickstart (Python SDK)

Quickstart (JS/TS SDK)

Observability & Tracing

Sessions

User Tracking

Environments

ABV Prompt Playground

Metadata

Trace IDs & Distributed Tracing

Log Levels

Comments on Objects

Masking of Sensitive LLM Data

Multi-Modality and Attachments

Event Queuing/Batching

Releases & Versioning

Sampling

Model Usage & Cost Tracking

Trace URLs

Query Data

API & Data Platform (cloned)

Metrics API (cloned with children)

Basic Features

Prompt Management Overview

Get Started with Prompt Management

ABV Prompts Data Model

Prompt Version Control

Prompt Composability

Message Placeholders in Chat Prompts

A/B Testing of LLM Prompts

Caching of Prompts in Client SDKs

Prompt Config

Prompt Folders

Guaranteed Availability

Link Prompts to Traces

Prompt Management

Evaluation Overview

Scores Data Model

LLM-as-a-Judge

Human Annotation

Custom Scores

Dataset Runs Data Model

Datasets

Prompt Experiments

Remote Dataset Runs

Evaluations

Overview of ABV SDKs

Python SDK - Overview

Python SDK - Setup

Python SDK - Instrumentation

Python SDK - Evaluations

Python SDK - Advanced Usage

Python SDK - Troubleshooting

Python SDK

TypeScript SDK - Overview

TypeScript SDK - Setup

TypeScript SDK - Instrumentation

TypeScript SDK - Advanced Configuration

TypeScript SDK - Troubleshooting and FAQ

JS/TS SDK

SDKs

API & Data Platform overview

Export Data from UI

Export via Blob Storage Integration

Export for Fine-Tuning

Public API

Query Data via SDKs

API & Data Platform

Role-Based Access Controls in ABV

Audit Logs

Data Deletion

Data Retention

LLM Connections

SCIM & Organization-Key Scoped API Routes

Usage Alerts

Administration

Platform

API Reference

References

Python SDK (v3)

JS SDK

Security & Compliance Overview

More