Unlock powerful LLM observability with ABV's tracing tools.  Debug agent behavior, track model costs in real-time, and optimize latency.

Observability & Tracing

Unlock the power of ABV sessions.  Learn how to group LLM application traces, create insightful session replays, and enhance your debugging and analysis capabilities.

Sessions

Learn how to implement user tracking in ABV.  Associate traces with a unique userId using our Python and JS/TS SDKs to segment by token usage and analyze user feedback.

User Tracking

Learn how to manage different environments in ABV.  Our documentation guides you through setting up, configuring, and deploying to development, staging, and production environments for your AI applications.

Environments

 Test and iterate on your prompts directly in the ABV Prompt Playground.  Tweak the prompt and model parameters to see how different models respond to these input changes.

ABV Prompt Playground

Effectively categorize and filter your traces in ABV with tags.  Learn how to add, remove, and use tags to streamline your debugging and analysis workflows.

Metadata

Learn how to implement distributed tracing with custom trace IDs in ABV.  Use your own domain-specific IDs with our Python and JS/TS SDKs for deep-linking, evaluating traces, and more.

Trace IDs & Distributed Tracing

Control the signal-to-noise ratio of your application logs with ABV's log levels.  Learn how to prioritize issues by severity to focus on what matters most and streamline your debugging process.

Log Levels

Collaborate with your team by adding comments to objects in ABV.  Flag issues, share insights, and leave feedback on traces, prompts, and more via the UI or API.

Comments on Objects

Secure your application by masking sensitive LLM data.  Our guide shows you how to use custom functions to redact PII, protect user privacy, and meet compliance standards.

Masking of Sensitive LLM Data

Learn how ABV supports multi-modal traces with attachments.  Automatically handle base64 encoded data, upload media with the ABVMedia class, and resolve media references in our Python and JS/TS SDKs.

Multi-Modality and Attachments

Learn about event queuing and batching in ABV.  Optimize API calls and network time by configuring batching behavior and manually flushing events in our Python and JS/TS SDKs.

Event Queuing/Batching

Learn how to track and version your LLM app's releases.  See the impact of changes on cost, latency, and quality to run effective A/B tests and experiments in production.

Releases & Versioning

Control your data volume with ABV's sampling feature.  Learn how to set a sample rate to collect a percentage of traces and reduce data for high-traffic applications using our Python and JS/TS SDKs.

Sampling

Track and manage your LLM costs.  Learn how to monitor model usage, analyze token consumption, and accurately calculate expenses for OpenAI, Anthropic, and custom models.

Model Usage & Cost Tracking

Learn how to manage and share trace URLs in ABV.  Get a direct URL for your logs or notebooks, and see how to make traces public via the UI or our Python & JS/TS SDKs.

Trace URLs

Query Data

Metrics API

Custom Dashboards

Quickstart (JS/TS SDK)

Basic Features

Trace

ABV Developer Docs

Quickstart (Python SDK)

API & Data Platform (cloned)

Metrics API (cloned with children)

Prompt Management Overview

Get Started with Prompt Management

ABV Prompts Data Model

Prompt Version Control

Prompt Composability

Message Placeholders in Chat Prompts

A/B Testing of LLM Prompts

Caching of Prompts in Client SDKs

Prompt Config

Prompt Folders

Guaranteed Availability

Link Prompts to Traces

Prompt Management

Evaluation Overview

Scores Data Model

LLM-as-a-Judge

Human Annotation

Custom Scores

Dataset Runs Data Model

Datasets

Prompt Experiments

Remote Dataset Runs

Evaluations

Overview of ABV SDKs

Python SDK - Overview

Python SDK - Setup

Python SDK - Instrumentation

Python SDK - Evaluations

Python SDK - Advanced Usage

Python SDK - Troubleshooting

Python SDK

TypeScript SDK - Overview

TypeScript SDK - Setup

TypeScript SDK - Instrumentation

TypeScript SDK - Advanced Configuration

TypeScript SDK - Troubleshooting and FAQ

Cookbook: ABV JS/TS SDK

JS/TS SDK

SDKs

Metrics overview

Metrics

API & Data Platform overview

Export Data from UI

Export via Blob Storage Integration

Export for Fine-Tuning

Public API

Query Data via SDKs

API & Data Platform

Role-Based Access Controls in ABV

Audit Logs

Data Deletion

Data Retention

LLM Connections

SCIM & Organization-Key Scoped API Routes

Usage Alerts

Administration

Platform

API Reference

References

Python SDK (v3)

JS SDK

Security & Compliance Overview

More