Skip to main content
ABV provides comprehensive tracking of LLM usage and costs, helping you understand and optimize your AI application expenses. This guide will help you get started with cost tracking and point you to the right resources.

​
What You Can Track

ABV monitors two key metrics for every LLM generation:

Usage Details

Number of units consumed per usage type (tokens, characters, etc.)

Cost Details

USD cost per usage type, calculated or ingested
Supported usage types:
  • input / output - Basic token counts
  • cached_tokens - Cached input tokens (Anthropic prompt caching)
  • audio_tokens - Audio input tokens
  • image_tokens - Image input tokens
  • reasoning_tokens - Reasoning tokens (OpenAI o1 models)
  • Custom usage types for your specific needs

​
How It Works

ABV supports two approaches to tracking usage and costs: Extract usage and cost data directly from your LLM provider’s API responses and send them to ABV. Best for:
  • Production applications
  • Accurate billing and cost allocation
  • All model types, including reasoning models

​
2. Infer from Model Definitions

Let ABV automatically calculate usage and costs using predefined tokenizers and pricing. Best for:
  • Development and prototyping
  • Supported models (OpenAI, Anthropic, Google)
  • Quick setup without code changes
Priority: When both ingested and inferred data are available, ABV always uses ingested values for accuracy.

​
Documentation Structure

This cost tracking documentation is organized into three focused guides:

Overview

Concepts & Decision MakingUnderstand ingest vs infer approaches, usage types, and when to use each method.

Implementation

Step-by-Step GuidesComplete code examples for Python and JavaScript/TypeScript SDKs with all integration methods.

Reference

API & Advanced ConfigCustom model definitions, tokenizers, pricing configuration, and the Models API.

​
Key Features

Many ABV integrations automatically capture usage and cost from LLM responses. Works with:
  • OpenAI
  • Anthropic
  • Google
  • And more…
Track any usage metric that matters to you:
  • Standard tokens (input/output)
  • Cached tokens
  • Audio and image tokens
  • Reasoning tokens
  • Custom metrics for your models
Define your own models with:
  • Custom pricing per usage type
  • Regex-based model matching
  • Tokenization configuration
  • Priority over default models
Access your usage data through:
  • Real-time dashboards in the UI
  • Daily Metrics API for export
  • Filtering by user, tag, or application
  • Integration with your billing systems

​
Supported Models

ABV comes with predefined support for popular models:
  • OpenAI: GPT-4, GPT-3.5, GPT-4o, o1 (reasoning models)
  • Anthropic: Claude 4 family (Opus, Sonnet, Haiku)
  • Google: Gemini models
View the complete list of supported models in the ABV UI under Settings → Model Definitions.
Don’t see your model? You can define custom models or request official support.