Extend and customize your LLM workflows with ABV's open data platform.  Learn how to export data, use the public API and SDK, and integrate with external tools for custom billing, reporting, and fine-tuning models.

API & Data Platform overview

Export ABV observability data for fine-tuning, analysis, or model training.  Learn to export to CSV/JSON, blob storage, or programmatically via our SDKs and API.

Export Data from UI

Learn how to schedule automated data exports from ABV to your Blob Storage.  This guide covers setting up hourly, daily, or weekly exports of traces, observations, and scores to AWS S3, GCS, or Azure Blob Storage.

Export via Blob Storage Integration

Learn how to export ABV data for fine-tuning.  This guide covers exporting generations in OpenAI JSONL format and filtering by quality scores to improve model performance.

Export for Fine-Tuning

Access all ABV data and features programmatically via our public REST API and SDKs.  This guide provides API endpoints, authentication details, and examples for our Python and JS/TS SDKs to integrate with your workflows.

Public API

Programmatically access your LLM data for fine-tuning or custom workflows.  Learn to use the ABV Python and JS/TS SDKs to query traces, scores, and more.

Query Data via SDKs

Metrics API

API & Data Platform

Trace

ABV Developer Docs

Quickstart (Python SDK)

Quickstart (JS/TS SDK)

Observability & Tracing

Sessions

User Tracking

Environments

ABV Prompt Playground

Metadata

Trace IDs & Distributed Tracing

Log Levels

Comments on Objects

Masking of Sensitive LLM Data

Multi-Modality and Attachments

Event Queuing/Batching

Releases & Versioning

Sampling

Model Usage & Cost Tracking

Trace URLs

Query Data

API & Data Platform (cloned)

Metrics API (cloned with children)

Custom Dashboards

Basic Features

Prompt Management Overview

Get Started with Prompt Management

ABV Prompts Data Model

Prompt Version Control

Prompt Composability

Message Placeholders in Chat Prompts

A/B Testing of LLM Prompts

Caching of Prompts in Client SDKs

Prompt Config

Prompt Folders

Guaranteed Availability

Link Prompts to Traces

Prompt Management

Evaluation Overview

Scores Data Model

LLM-as-a-Judge

Human Annotation

Custom Scores

Dataset Runs Data Model

Datasets

Prompt Experiments

Remote Dataset Runs

Evaluations

Overview of ABV SDKs

Python SDK - Overview

Python SDK - Setup

Python SDK - Instrumentation

Python SDK - Evaluations

Python SDK - Advanced Usage

Python SDK - Troubleshooting

Python SDK

TypeScript SDK - Overview

TypeScript SDK - Setup

TypeScript SDK - Instrumentation

TypeScript SDK - Advanced Configuration

TypeScript SDK - Troubleshooting and FAQ

Cookbook: ABV JS/TS SDK

JS/TS SDK

SDKs

Metrics overview

Metrics

Role-Based Access Controls in ABV

Audit Logs

Data Deletion

Data Retention

LLM Connections

SCIM & Organization-Key Scoped API Routes

Usage Alerts

Administration

Platform

API Reference

References

Python SDK (v3)

JS SDK

Security & Compliance Overview

More