Skip to content

BlockRunAI/blockrun-llm

Repository files navigation

BlockRun LLM SDK (Python)

blockrun-llm is a Python SDK for accessing 80+ large language models (GPT-5.x, Claude 4.x, Gemini 3.x, DeepSeek, Grok 4.x, GLM, MiniMax, Moonshot and more) plus image / video / music generation, Grok Live Search, prediction-market data (Predexon), Exa neural web search, and Pyth-backed market data — all with automatic pay-per-request USDC micropayments via the x402 protocol. No API keys required; your wallet signature is your authentication. Built for AI agents that need to operate autonomously.

🆓 Includes 8 fully-free NVIDIA-hosted models — DeepSeek V4 Flash (1M context), Nemotron Nano Omni (vision), Qwen3 Next + Coder, Llama 4 Maverick, Mistral Small 4, plus gpt-oss-120b/20b (hidden from /v1/models but direct calls still work). Zero USDC, no rate-limit gimmicks. Use routing_profile="free" or call any nvidia/* model directly.

PyPI License: MIT

BlockRun assumes Claude Code as the agent runtime.

Supported Chains

Chain Network Payment Status
Base Base Mainnet (Chain ID: 8453) USDC ✅ Primary
Base Testnet Base Sepolia (Chain ID: 84532) Testnet USDC ✅ Development
Solana Solana Mainnet USDC (SPL) ✅ New

XRPL (RLUSD): Use blockrun-llm-xrpl for XRPL payments

Protocol: x402 v2

Installation

pip install blockrun-llm              # Base chain (EVM/USDC) — includes all core deps
pip install blockrun-llm[solana]      # Base + Solana (USDC SPL) payments
pip install blockrun-llm[dev]         # Base + dev tools (pytest, black, ruff, mypy)
pip install blockrun-llm[dev,solana]  # Everything

Quick Start

from blockrun_llm import LLMClient

client = LLMClient()  # Uses BLOCKRUN_WALLET_KEY (never sent to server)
response = client.chat("openai/gpt-5.2", "Hello!")

That's it. The SDK handles x402 payment automatically.

Try It Free (No USDC Required)

Want to kick the tires before funding a wallet? Route to BlockRun's free NVIDIA tier:

from blockrun_llm import LLMClient

client = LLMClient()  # Wallet still required for signing, but $0 charged

# Option 1: call a free model directly
response = client.chat("nvidia/qwen3-next-80b-a3b-thinking", "Explain x402 in 1 sentence")

# Option 2: let the smart router pick the best free model per request
result = client.smart_chat("What is 2+2?", routing_profile="free")
print(result.model)     # e.g. 'nvidia/deepseek-v4-flash' (cheapest capable for SIMPLE tier)
print(result.response)  # '4'

Available free models (input + output both $0, all NVIDIA-hosted):

Model ID Context Best For
nvidia/deepseek-v4-flash 1M DeepSeek V4 Flash — 284B / 13B active MoE, ~5× faster than V4 Pro. Best free chat / summarization / light reasoning
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning 256K Only vision-capable free model — text + images + video (≤2 min) + audio (≤1 hr)
nvidia/qwen3-next-80b-a3b-thinking 131K 116 tok/s reasoning with thinking mode
nvidia/mistral-small-4-119b 131K 114 tok/s — fastest free chat
nvidia/llama-4-maverick 131K Meta Llama 4 Maverick MoE
nvidia/qwen3-coder-480b 131K Coding-optimised 480B MoE
nvidia/gpt-oss-120b 128K OpenAI open-weight 120B — 123 tok/s. Hidden from /v1/models (so SmartChat won't auto-pick it) but direct calls still work
nvidia/gpt-oss-20b 128K OpenAI open-weight 20B — 155 tok/s. Hidden from /v1/models but direct calls still work

Need V4-Pro-class reasoning? Use the paid deepseek/deepseek-v4-pro ($0.50/$1.00 with the 75% promo through 2026-05-31) — nvidia/deepseek-v4-pro is hidden because NVIDIA's NIM deployment is hung; backend MODEL_REDIRECTS forwards calls to V4 Flash.

Privacy note for gpt-oss-120b/20b: NVIDIA's free build.nvidia.com tier reserves the right to use prompts/outputs for service improvement. The models are hidden from /v1/models so SmartChat won't auto-route to them, but direct calls still work — use them only when prompts contain no sensitive data.

Solana Support

Pay for AI calls with Solana USDC via sol.blockrun.ai:

from blockrun_llm import SolanaLLMClient

# SOLANA_WALLET_KEY env var (bs58-encoded Solana secret key)
client = SolanaLLMClient()

# Or pass key directly
client = SolanaLLMClient(private_key="your-bs58-solana-key")

# Same API as LLMClient
response = client.chat("openai/gpt-5.2", "gm Solana")
print(response)

# DeepSeek on Solana
answer = client.chat("deepseek/deepseek-chat", "Explain Solana consensus", temperature=0.5)

Setup:

pip install blockrun-llm[solana]
export SOLANA_WALLET_KEY="your-bs58-solana-key"

Endpoint: https://sol.blockrun.ai/api Payment: Solana USDC (SPL Token, mainnet)

Smart Routing (ClawRouter)

Let the SDK automatically pick the cheapest capable model for each request:

from blockrun_llm import LLMClient

client = LLMClient()

# Auto-routes to cheapest capable model
result = client.smart_chat("What is 2+2?")
print(result.response)  # '4'
print(result.model)     # 'moonshot/kimi-k2.6' (Moonshot flagship — vision + reasoning_content)
print(f"Saved {result.routing.savings * 100:.0f}%")  # 'Saved 94%'

# Complex reasoning task -> routes to reasoning model
result = client.smart_chat("Prove the Riemann hypothesis step by step")
print(result.model)  # 'deepseek/deepseek-reasoner'

Routing Profiles

Profile Description Best For
free NVIDIA free tier — smart-routes across 9 models (DeepSeek V4 Pro/Flash, Nemotron Nano Omni, Qwen3, GLM-4.7, Llama 4, Mistral) Zero-cost testing, dev, prod
eco Cheapest models per tier (DeepSeek, NVIDIA) Cost-sensitive production
auto Best balance of cost/quality (default) General use
premium Top-tier models (OpenAI, Anthropic) Quality-critical tasks
# Use premium models for complex tasks
result = client.smart_chat(
    "Write production-grade async Python code",
    routing_profile="premium"
)
print(result.model)  # 'openai/gpt-5.4'

How It Works

ClawRouter uses a 14-dimension rule-based classifier to analyze each request:

  • Token count - Short vs long prompts
  • Code presence - Programming keywords
  • Reasoning markers - "prove", "step by step", etc.
  • Technical terms - Architecture, optimization, etc.
  • Creative markers - Story, poem, brainstorm, etc.
  • Agentic patterns - Multi-step, tool use indicators

The classifier runs in <1ms, 100% locally, and routes to one of four tiers:

Tier Example Tasks Auto Profile Model
SIMPLE "What is 2+2?", definitions moonshot/kimi-k2.6
MEDIUM Code snippets, explanations google/gemini-2.5-flash
COMPLEX Architecture, long documents google/gemini-3.1-pro
REASONING Proofs, multi-step reasoning deepseek/deepseek-reasoner

How It Works

  1. You send a request to BlockRun's API
  2. The API returns a 402 Payment Required with the price
  3. The SDK automatically signs a USDC payment on Base
  4. The request is retried with the payment proof
  5. You receive the AI response

Your private key never leaves your machine - it's only used for local signing.

Available Models

OpenAI GPT-5.5 Family

Released 2026-04-23 — first fully retrained base since GPT-4.5. 1M context, 128K output, native agent + computer use.

Model Input Price Output Price Context
openai/gpt-5.5 $5.00/M $30.00/M 1M

OpenAI GPT-5.4 Family

Model Input Price Output Price Context
openai/gpt-5.4 $2.50/M $15.00/M 1M
openai/gpt-5.4-pro $30.00/M $180.00/M 1M
openai/gpt-5.4-mini $0.75/M $4.50/M 400K
openai/gpt-5.4-nano $0.20/M $1.25/M 1M

OpenAI GPT-5 Family

Model Input Price Output Price Context
openai/gpt-5.3 $1.75/M $14.00/M 128K
openai/gpt-5.2 $1.75/M $14.00/M 400K
openai/gpt-5-mini $0.25/M $2.00/M 200K
openai/gpt-5.2-pro $21.00/M $168.00/M 400K
openai/gpt-5.3-codex $1.75/M $14.00/M 400K

OpenAI O-Series (Reasoning)

Model Input Price Output Price Context
openai/o1 $15.00/M $60.00/M 200K
openai/o1-mini $1.10/M $4.40/M 128K
openai/o3 $2.00/M $8.00/M 200K
openai/o3-mini $1.10/M $4.40/M 128K

Anthropic Claude

Model Input Price Output Price Context Notes
anthropic/claude-opus-4.7 $5.00/M $25.00/M 1M Most capable Claude — agentic coding + adaptive thinking, 128K output
anthropic/claude-opus-4.6 $5.00/M $25.00/M 200K Hidden from /v1/models (superseded by 4.7); direct calls still work
anthropic/claude-opus-4.5 $5.00/M $25.00/M 200K
anthropic/claude-sonnet-4.6 $3.00/M $15.00/M 200K
anthropic/claude-haiku-4.5 $1.00/M $5.00/M 200K

Google Gemini

Model Input Price Output Price Context
google/gemini-3.1-pro $2.00/M $12.00/M 1M
google/gemini-3-pro-preview $2.00/M $12.00/M 1M
google/gemini-3-flash-preview $0.50/M $3.00/M 1M
google/gemini-2.5-pro $1.25/M $10.00/M 1M
google/gemini-2.5-flash $0.30/M $2.50/M 1M
google/gemini-3.1-flash-lite $0.25/M $1.50/M 1M
google/gemini-2.5-flash-lite $0.10/M $0.40/M 1M

DeepSeek

V4 family launched 2026-04-24. DeepSeek upstream now serves the legacy deepseek-chat / deepseek-reasoner aliases as V4 Flash non-thinking / thinking modes. V4 Pro is the new flagship paid SKU — 1.6T MoE / 49B active, 1M context, MMLU-Pro 87.5, GPQA 90.1, SWE-bench 80.6, LiveCodeBench 93.5.

Model Input Price Output Price Context Notes
deepseek/deepseek-v4-pro $0.50/M $1.00/M 1M V4 flagship — strongest open-weight reasoner. 75% off until 2026-05-31 (list $2.00/$4.00)
deepseek/deepseek-chat $0.20/M $0.40/M 1M V4 Flash non-thinking (paid endpoint with 5MB request bodies; same upstream as nvidia/deepseek-v4-flash)
deepseek/deepseek-reasoner $0.20/M $0.40/M 1M V4 Flash thinking (same upstream as deepseek-chat, thinking enabled by default)

MiniMax

Model Input Price Output Price Context
minimax/minimax-m2.7 $0.30/M $1.20/M 200K

ZAI

The GLM-5 family bills as flat $0.001/call (no token counting) — /v1/models reports them under billing_mode: "flat". Per-call pricing makes them cheapest-of-class for short prompts.

Model Price Context Notes
zai/glm-5.1 $0.001/call 200K Z.AI's latest flagship — #1 open-source on SWE-Bench Pro, 8-hour autonomous execution
zai/glm-5 $0.001/call 200K
zai/glm-5-turbo $0.001/call 200K

NVIDIA (Free & Hosted)

Free tier refreshed 2026-04-28: added nvidia/deepseek-v4-flash (1M context) and nvidia/nemotron-3-nano-omni-30b-a3b-reasoning (vision). nvidia/gpt-oss-120b and nvidia/gpt-oss-20b were briefly delisted over privacy concerns (NVIDIA's free build.nvidia.com tier reserves the right to use prompts for service improvement) but re-enabled 2026-04-30 with available: true + hidden: true — they no longer appear in /v1/models (so SmartChat won't auto-pick them) but direct calls by full ID still return HTTP 200. nvidia/deepseek-v4-pro, nvidia/deepseek-v3.2, and nvidia/glm-4.7 are hidden because NVIDIA's NIM deployment is hung — backend MODEL_REDIRECTS auto-forwards calls to V4 Flash / qwen3-coder.

Model Input Price Output Price Context Notes
nvidia/deepseek-v4-flash FREE FREE 1M DeepSeek V4 Flash — 284B / 13B active MoE, ~5× faster than V4 Pro. Best free chat / summarization
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning FREE FREE 256K First vision-capable free model — RGB images, mp4 video
nvidia/qwen3-next-80b-a3b-thinking FREE FREE 131K Reasoning flagship — 116 tok/s, thinking mode
nvidia/mistral-small-4-119b FREE FREE 131K Fastest chat — 114 tok/s
nvidia/llama-4-maverick FREE FREE 131K Meta Llama 4 Maverick MoE
nvidia/qwen3-coder-480b FREE FREE 131K Coding-optimised 480B MoE
nvidia/gpt-oss-120b FREE FREE 128K OpenAI open-weight 120B — 123 tok/s. Hidden from /v1/models; direct calls work
nvidia/gpt-oss-20b FREE FREE 128K OpenAI open-weight 20B — 155 tok/s. Hidden from /v1/models; direct calls work
moonshot/kimi-k2.5 $0.60/M $3.00/M 262K Kimi K2.5 direct from Moonshot (replaces nvidia/kimi-k2.5)
moonshot/kimi-k2.6 $0.95/M $4.00/M 256K Moonshot flagship (vision + reasoning_content)

Testnet Models (Base Sepolia)

Model Price
openai/gpt-oss-20b $0.001/request
openai/gpt-oss-120b $0.002/request

Testnet models use flat pricing (no token counting) for simplicity.

Verifying Models End-to-End

The SDK ships two runnable sweep scripts under examples/:

# Chat LLMs — every chat model the SDK exposes
python examples/sweep_all_chat_models.py --output-json sweep-results.json

# Image + music models (video excluded — long polling, expensive per clip)
python examples/sweep_all_media_models.py --output-json sweep-media-results.json

Each script captures per-model status, latency, token counts, and per-call cost, prints a grouped report, and exits non-zero if any expected-to-work model fails. Useful before a release or after router/catalog changes.

smart_chat() and chat() accept an optional fallback_models=[...] list — on timeout / 5xx / network error the SDK transparently walks the chain before raising. smart_chat() populates this from the tier's fallback list automatically.

Image Generation

Model Price
openai/dall-e-3 $0.04/image
openai/gpt-image-1 $0.02/image
openai/gpt-image-2 $0.06/image (reasoning-driven, multilingual text rendering, character consistency)
google/nano-banana $0.05/image
google/nano-banana-pro $0.10/image
xai/grok-imagine-image $0.02/image
xai/grok-imagine-image-pro $0.07/image
zai/cogview-4 $0.015/image

Image editing (client.edit): openai/gpt-image-1 and openai/gpt-image-2 both support the /v1/images/image2image endpoint.

Video Generation

Model Price
xai/grok-imagine-video $0.05/sec (8s default → $0.42/clip)
bytedance/seedance-1.5-pro $0.03/sec (5s default, up to 10s, 720p)
bytedance/seedance-2.0-fast $0.15/sec (~60-80s gen, sweet-spot price/quality)
bytedance/seedance-2.0 $0.30/sec (720p Pro)
from blockrun_llm import VideoClient

client = VideoClient()
result = client.generate("a red apple slowly spinning on a wooden table")
print(result.data[0].url)            # permanent MP4 URL
print(result.data[0].duration_seconds)  # 8

# Image-to-video
result = client.generate(
    "the subject turns its head and smiles",
    image_url="https://example.com/portrait.jpg",
)

Standalone Search (SearchClient)

SearchClient wraps POST /v1/search — standalone Grok Live Search with automatic x402 payment. Pricing: $0.025/source + margin (10 sources ≈ $0.26).

from blockrun_llm import SearchClient

client = SearchClient()
result = client.search(
    "Latest news on x402 adoption",
    sources=["x", "web"],
    max_results=10,
)
print(result.summary)
for url in result.citations or []:
    print(url)

Market Data (PriceClient)

Pyth-backed realtime quotes and OHLC history across crypto, FX, commodities and 12 global equity markets. Crypto / FX / commodity are fully free across price, history and list; stocks (stocks/{market} and the usstock legacy alias) charge $0.001 per price or history call. Pass require_wallet=False when you only need free endpoints.

from blockrun_llm import PriceClient

# Free usage — no wallet
p = PriceClient(require_wallet=False)
btc = p.price("crypto", "BTC-USD")
eur = p.price("fx", "EUR-USD")
symbols = p.list_symbols("crypto", q="sol", limit=20)

# Paid — requires a wallet
p2 = PriceClient()
aapl = p2.price("stocks", "AAPL", market="us")
bars = p2.history(
    "stocks", "AAPL",
    market="us",
    resolution="D",
    from_ts=1_700_000_000,
    to_ts=1_710_000_000,
)

Supported stock markets: us, hk, jp, kr, gb, de, fr, nl, ie, lu, cn, ca.

Prediction Markets (Powered by Predexon v2)

Access real-time prediction market data from Polymarket, Kalshi, Limitless, sports, and Binance Futures via Predexon. No API keys needed — pay-per-request via x402. Tier 1 endpoints are $0.001/call, Tier 2 (wallet identity / clustering) are $0.005/call.

Each method below is available on LLMClient (Base), AsyncLLMClient, and SolanaLLMClient.

Typed helpers

Method Endpoint Tier
pm_markets(**filters) canonical cross-venue markets 1
pm_listings(**filters) venue-native executable listings 1
pm_outcome(predexon_id) resolve a canonical outcome 1
pm_polymarket_markets(**filters) Polymarket markets (offset pagination) 1
pm_polymarket_events(**filters) Polymarket events (offset pagination) 1
pm_polymarket_markets_keyset(**filters) Polymarket markets, cursor pagination 1
pm_polymarket_events_keyset(**filters) Polymarket events, cursor pagination 1
pm_polymarket_positions(**filters) per-wallet open positions + PnL 1
pm_polymarket_trades(**filters) recent trades (token, side, price, tx_hash) 1
pm_polymarket_leaderboard(**filters) trader leaderboard (window, sort_by) 1
pm_kalshi_markets(**filters) Kalshi event contracts 1
pm_limitless_markets(**filters) Limitless binary AMM markets 1
pm_sports_categories() available sports categories 1
pm_sports_markets(**filters) sports markets grouped by game 1
pm_wallet_identity(wallet) identity + profile for one wallet 2
pm_wallet_identities(addresses) bulk identity for ≤200 wallets (POST) 2
pm_wallet_cluster(address) on-chain transfer + identity-proof cluster 2
from blockrun_llm import LLMClient

client = LLMClient()

# Canonical cross-venue snapshot
markets = client.pm_markets(status="active", limit=20)
listings = client.pm_listings(venue="polymarket", limit=20)

# Polymarket
events = client.pm_polymarket_events(limit=10)
positions = client.pm_polymarket_positions(user="0xABC123...")
top = client.pm_polymarket_leaderboard(window="7d", sort_by="pnl", limit=10)

# Sports + Kalshi + Limitless
games = client.pm_sports_markets(league="NBA", limit=10)
kalshi = client.pm_kalshi_markets(limit=10)
limitless = client.pm_limitless_markets(limit=10)

# Wallet identity (Tier 2)
profile = client.pm_wallet_identity("0xABC123...")
batch = client.pm_wallet_identities(["0xABC...", "0xDEF..."])
cluster = client.pm_wallet_cluster("0xABC123...")

Generic passthrough

For endpoints without a typed helper, drop down to pm() (GET) or pm_query() (POST). Same pricing tiers, same return shape:

candles = client.pm("polymarket/candlesticks/0x1234abcd...")  # OHLCV
btc = client.pm("binance/candles/BTCUSDT")                    # crypto candles
pairs = client.pm("matching-markets/pairs")                   # cross-platform pairs

Exa Web Search (Powered by Exa)

Access Exa's neural web search via x402. No API keys needed — pay-per-request in USDC. Available on both LLMClient (Base, recommended) and SolanaLLMClient (Solana).

Endpoint Method Price
exa_search Neural/keyword web search $0.01/request
exa_find_similar Find semantically similar pages $0.01/request
exa_contents Extract full text from URLs $0.002/URL
exa_answer AI answer grounded in web search $0.01/request
from blockrun_llm import LLMClient

client = LLMClient()  # uses BLOCKRUN_WALLET_KEY (Base USDC)

# Neural web search ($0.01/request)
results = client.exa_search("latest AI safety research", numResults=5)
results = client.exa_search("bitcoin ETF news", category="news", numResults=10)

# Find similar pages ($0.01/request)
similar = client.exa_find_similar("https://openai.com/research/gpt-4", numResults=5)

# Extract content from URLs ($0.002/URL)
content = client.exa_contents(["https://arxiv.org/abs/2303.08774"])
content = client.exa_contents(
    ["https://example.com/page1", "https://example.com/page2"],
    text=True,
    highlights=True,
)

# AI-generated answer from live web ($0.01/request)
answer = client.exa_answer("What is the current state of AI safety research?")

# Generic proxy for any Exa endpoint
result = client.exa("search", {"query": "transformer architecture", "numResults": 5})

For Solana payments use from blockrun_llm import SolanaLLMClient — same method names, same call shape; the Solana gateway requires the backend to be configured with EXA_API_KEY, so prefer Base unless you need SOL/SPL settlement.

Standalone Search

Search web, X/Twitter, and news without using a chat model:

from blockrun_llm import LLMClient

client = LLMClient()

result = client.search("latest AI agent frameworks 2026")
print(result.summary)
for cite in result.citations or []:
    print(f"  - {cite}")

# Filter by source type and date range
result = client.search(
    "BlockRun x402",
    sources=["web", "x"],
    from_date="2026-01-01",
    max_results=5,
)

Image Editing (img2img)

Edit existing images with text prompts:

from blockrun_llm import LLMClient, ImageClient

# Via LLMClient
client = LLMClient()
result = client.image_edit(
    prompt="Make the sky purple and add northern lights",
    image="data:image/png;base64,...",  # base64 or URL
    model="openai/gpt-image-1",
)
print(result.data[0].url)

# Via ImageClient
img_client = ImageClient()
result = img_client.edit("Add a rainbow", image="https://example.com/photo.jpg")

Usage Examples

Simple Chat

from blockrun_llm import LLMClient

client = LLMClient()  # Uses BLOCKRUN_WALLET_KEY (never sent to server)

response = client.chat("openai/gpt-5.2", "Explain quantum computing")
print(response)

# With system prompt
response = client.chat(
    "anthropic/claude-sonnet-4.6",
    "Write a haiku",
    system="You are a creative poet."
)

Real-time Search (Live Search)

Note: Live Search can take 30-120+ seconds as it searches multiple sources. The SDK automatically uses a 5-minute timeout for search requests.

from blockrun_llm import LLMClient

client = LLMClient()

# Simple: Enable live search with search=True (default 10 sources, ~$0.26)
response = client.chat(
    "openai/gpt-5.2",
    "What are the latest posts from @blockrunai?",
    search=True
)
print(response)

# Custom: Limit sources to reduce cost (5 sources, ~$0.13)
response = client.chat(
    "openai/gpt-5.2",
    "What's trending on X?",
    search_parameters={"mode": "on", "max_search_results": 5}
)

# Custom timeout (if 5 min isn't enough)
client = LLMClient(search_timeout=600.0)  # 10 minutes

Check Spending

from blockrun_llm import LLMClient

client = LLMClient()

response = client.chat("openai/gpt-5.2", "Explain quantum computing")
print(response)

# Check how much was spent
spending = client.get_spending()
print(f"Spent ${spending['total_usd']:.4f} across {spending['calls']} calls")

Full Chat Completion

from blockrun_llm import LLMClient

client = LLMClient()  # Uses BLOCKRUN_WALLET_KEY (never sent to server)

messages = [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "How do I read a file in Python?"}
]

result = client.chat_completion("openai/gpt-5.2", messages)
print(result.choices[0].message.content)

Async Usage

import asyncio
from blockrun_llm import AsyncLLMClient

async def main():
    async with AsyncLLMClient() as client:
        # Simple chat
        response = await client.chat("openai/gpt-5.2", "Hello!")
        print(response)

        # Multiple requests concurrently
        tasks = [
            client.chat("openai/gpt-5.2", "What is 2+2?"),
            client.chat("anthropic/claude-sonnet-4.6", "What is 3+3?"),
            client.chat("google/gemini-2.5-flash", "What is 4+4?"),
        ]
        responses = await asyncio.gather(*tasks)
        for r in responses:
            print(r)

asyncio.run(main())

List Available Models

from blockrun_llm import LLMClient

client = LLMClient()
models = client.list_models()

for model in models:
    print(f"{model['id']}: ${model['inputPrice']}/M input, ${model['outputPrice']}/M output")

Testnet Usage

For development and testing without real USDC, use the testnet:

from blockrun_llm import testnet_client

# Create testnet client (uses Base Sepolia)
client = testnet_client()  # Uses BLOCKRUN_WALLET_KEY

# Chat with testnet model
response = client.chat("openai/gpt-oss-20b", "Hello!")
print(response)

# Check testnet USDC balance
balance = client.get_balance()
print(f"Testnet USDC: ${balance:.4f}")

Testnet Setup

  1. Get testnet ETH from Alchemy Base Sepolia Faucet
  2. Get testnet USDC from Circle USDC Faucet
  3. Set your wallet key: export BLOCKRUN_WALLET_KEY=0x...

Available Testnet Models

  • openai/gpt-oss-20b - $0.001/request (flat price)
  • openai/gpt-oss-120b - $0.002/request (flat price)

Manual Testnet Configuration

from blockrun_llm import LLMClient

# Or configure manually
client = LLMClient(api_url="https://testnet.blockrun.ai/api")
response = client.chat("openai/gpt-oss-20b", "Hello!")

Billing & Cost Tracking

Every paid call appends one line to ~/.blockrun/cost_log.jsonl capturing timestamp, endpoint, cost, and (when available) model, wallet, network, and client_kind. The SDK ships a small reader / exporter on top so you can audit spending without leaving the Python ecosystem.

CLI

# Aggregated summary, default grouped by endpoint
python -m blockrun_llm.billing summary

# Group by model / month / wallet / network / client_kind / day
python -m blockrun_llm.billing summary --group-by model
python -m blockrun_llm.billing summary --group-by month --from 2026-04-01

# Filter by wallet (when one machine drives multiple keys)
python -m blockrun_llm.billing summary --wallet 0xCC8c... --network base-mainnet

# Export per-call records
python -m blockrun_llm.billing export csv  --from 2026-05-01 --output may.csv
python -m blockrun_llm.billing export json --to 2026-05-09

Python API

from blockrun_llm import (
    get_cost_log_summary,
    export_cost_log_csv,
    export_cost_log_json,
)

summary = get_cost_log_summary(group_by="model", from_date="2026-04-01")
print(summary["total_usd"], summary["calls"])
for model, slot in summary["groups"].items():
    print(f"  {model:40s}  {slot['calls']:>5}  ${slot['cost_usd']:.4f}")

# Returns CSV / JSON text; pass output_path to also write to disk
csv_text  = export_cost_log_csv("bill.csv", from_date="2026-05-01")
json_text = export_cost_log_json(from_date="2026-05-01")

Example output

Real session — four cheap chat calls across providers, then queried by model:

$ python -m blockrun_llm.billing summary --from 2026-05-10 --group-by model
================================================================
BLOCKRUN — LOCAL COST LOG SUMMARY
================================================================
  log file       : /Users/me/.blockrun/cost_log.jsonl
  from           : 2026-05-10
  group_by       : model
  total          : $0.0070 (9 calls)

  KEY                             CALLS        COST
  ----------------------------  -------  ----------
  deepseek/deepseek-chat              2     $0.0020
  google/gemini-2.5-flash-lite        1     $0.0010
  anthropic/claude-haiku-4.5          1     $0.0010
  zai/glm-5-turbo                     1     $0.0010
  unknown                             4     $0.0020

The four unknown rows are pre-existing entries from before this release — they had only {ts, endpoint, cost_usd} so the model column reads unknown. Calls made after upgrading carry the full metadata (wallet / network / client_kind / model). CSV export shows it directly:

$ python -m blockrun_llm.billing export csv --from 2026-05-10 | head -3
ts_iso,endpoint,model,wallet,network,client_kind,cost_usd
2026-05-10T03:38:28.198937+00:00,/v1/chat/completions,deepseek/deepseek-chat,0xCC8c...5EF8,base-mainnet,LLMClient,0.001
2026-05-10T03:38:31.192060+00:00,/v1/chat/completions,google/gemini-2.5-flash-lite,0xCC8c...5EF8,base-mainnet,LLMClient,0.001

Scope

The cost log is per-machine. It records calls made by this Python SDK only — calls from other clients (TS SDK, MCP, raw curl) are not included. For organization-wide billing, query the gateway's authoritative ledger.

Environment Variables

Variable Description Required
BLOCKRUN_WALLET_KEY Your Base chain wallet private key Yes (or pass to constructor)
BLOCKRUN_API_URL API endpoint No (default: https://blockrun.ai/api)

Setting Up Your Wallet

  1. Create a wallet on Base network (Coinbase Wallet, MetaMask, etc.)
  2. Get some ETH on Base for gas (small amount, ~$1)
  3. Get USDC on Base for API payments
  4. Export your private key and set it as BLOCKRUN_WALLET_KEY
# .env file
BLOCKRUN_WALLET_KEY=0x...your_private_key_here

Error Handling

from blockrun_llm import LLMClient, APIError, PaymentError

client = LLMClient()

try:
    response = client.chat("openai/gpt-5.2", "Hello!")
except PaymentError as e:
    print(f"Payment failed: {e}")
    # Check your USDC balance
except APIError as e:
    print(f"API error ({e.status_code}): {e}")

Testing

Running Unit Tests

Unit tests do not require API access or funded wallets:

pytest tests/unit                    # Run unit tests only
pytest tests/unit --cov              # Run with coverage report
pytest tests/unit -v                 # Verbose output

Running Integration Tests

Integration tests call the production API and require:

  • A funded Base wallet with USDC ($1+ recommended)
  • BLOCKRUN_WALLET_KEY environment variable set
  • Estimated cost: ~$0.05 per test run
export BLOCKRUN_WALLET_KEY=0x...
pytest tests/integration             # Run integration tests only
pytest                               # Run all tests

Integration tests are automatically skipped if BLOCKRUN_WALLET_KEY is not set.

Security

Private Key Safety

  • Private key stays local: Your key is only used for signing on your machine
  • No custody: BlockRun never holds your funds
  • Verify transactions: All payments are on-chain and verifiable

Best Practices

Private Key Management:

  • Use environment variables, never hard-code keys
  • Use dedicated wallets for API payments (separate from main holdings)
  • Set spending limits by only funding payment wallets with small amounts
  • Never commit .env files to version control
  • Rotate keys periodically

Input Validation: The SDK validates all inputs before API requests:

  • Private keys (format, length, valid hex)
  • API URLs (HTTPS required for production, HTTP allowed for localhost)
  • Model names and parameters (ranges for max_tokens, temperature, top_p)

Error Sanitization: API errors are automatically sanitized to prevent sensitive information leaks.

Monitoring:

address = client.get_wallet_address()
print(f"View transactions: https://basescan.org/address/{address}")

Keep Updated:

pip install --upgrade blockrun-llm  # Get security patches

Agent Wallet Setup

One-line setup for agent runtimes (Claude Code skills, MCP servers, etc.):

from blockrun_llm import setup_agent_wallet

# Auto-creates wallet if none exists, returns ready client
client = setup_agent_wallet()
response = client.chat("openai/gpt-5.4", "Hello!")

For Solana:

from blockrun_llm import setup_agent_solana_wallet

client = setup_agent_solana_wallet()
response = client.chat("anthropic/claude-sonnet-4.6", "Hello!")

Check wallet status:

from blockrun_llm import status

status()
# Wallet: 0xCC8c...5EF8
# Balance: $5.30 USDC

Wallet Scanning

The SDK auto-detects wallets from any provider on your system:

from blockrun_llm.wallet import scan_wallets
from blockrun_llm.solana_wallet import scan_solana_wallets

# Scans ~/.<dir>/wallet.json for Base wallets
base_wallets = scan_wallets()

# Scans ~/.<dir>/solana-wallet.json
sol_wallets = scan_solana_wallets()

get_or_create_wallet() checks scanned wallets first, so if you already have a wallet from another BlockRun tool, it will be reused automatically.

Response Caching

The SDK caches responses to avoid duplicate payments:

from blockrun_llm import clear_cache

# Automatic TTLs by endpoint:
# - Prediction Markets: 30 minutes
# - Search: 15 minutes
# - Models: 24 hours
# - Chat/Image: no cache (every call is unique)

# Manual cache management
removed = clear_cache()  # Remove all cached responses

Per-session spending is also available on any client (see also Billing & Cost Tracking for the full surface):

from blockrun_llm import LLMClient

client = LLMClient()
response = client.chat("openai/gpt-5.2", "Hello!")

spending = client.get_spending()
print(f"Session: ${spending['total_usd']:.4f} across {spending['calls']} calls")

Anthropic SDK Compatibility

Use the official Anthropic Python SDK with BlockRun's API gateway and automatic x402 payments:

pip install blockrun-llm[anthropic]
from blockrun_llm import AnthropicClient

client = AnthropicClient()  # Auto-detects wallet, auto-pays

response = client.messages.create(
    model="claude-sonnet-4-6",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.content[0].text)

# Works with any BlockRun model in Anthropic format
response = client.messages.create(
    model="openai/gpt-5.4",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello from GPT!"}]
)

The AnthropicClient wraps anthropic.Anthropic with a custom httpx transport that handles x402 payment signing transparently. Your private key never leaves your machine.

Links

Frequently Asked Questions

What is blockrun-llm?

blockrun-llm is a Python SDK that provides pay-per-request access to 43+ large language models from OpenAI, Anthropic, Google, DeepSeek, NVIDIA, ZAI, and more. It uses the x402 protocol for automatic USDC micropayments — no API keys, no subscriptions, no vendor lock-in.

How does payment work?

When you make an API call, the SDK automatically handles x402 payment. It signs a USDC transaction locally using your wallet private key (which never leaves your machine), and includes the payment proof in the request header. Settlement is non-custodial and instant on Base or Solana.

What is smart routing / ClawRouter?

ClawRouter is a built-in smart routing engine that analyzes your request across 14 dimensions and automatically picks the cheapest model capable of handling it. Routing happens locally in under 1ms. It can save up to 92% on LLM costs compared to using premium models for every request.

How much does it cost?

Pay only for what you use. Prices start at FREE (11 NVIDIA-hosted models). Paid models start at $0.10/M tokens. There are no minimums, subscriptions, or monthly fees. $5 in USDC gets you thousands of requests.

Can I use it with Solana?

Yes. Install with pip install blockrun-llm[solana] and use SolanaLLMClient instead of LLMClient. Same API, different payment chain.

License

MIT

About

Python SDK for BlockRun — 41+ AI models, pay-per-call with USDC. OpenAI-compatible. Zero rate limits.

Resources

License

Contributing

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages