ci(ai): Route Anthropic tests through OpenRouter by sentry-junior[bot] · Pull Request #154 · getsentry/testing-ai-sdk-integrations

sentry-junior · 2026-07-31T11:28:24Z

Route Anthropic-compatible test traffic through OpenRouter so the integration suite no longer needs a direct Anthropic API key. The suite continues exercising Anthropic SDK, Vercel AI SDK, LangChain, LangGraph, and LiteLLM paths while using OPENROUTER_API_KEY and OpenRouter's Anthropic-compatible endpoint.

Credential contract

CI, local setup, and the composite action now accept OPENROUTER_API_KEY / openrouter-api-key instead of the Anthropic credential.

Provider routing

Anthropic clients receive https://openrouter.ai/api explicitly. LiteLLM's Anthropic cases use its OpenRouter provider while preserving Anthropic model IDs.

Callers / companion PRs

Framework change: this PR
Python SDK caller: ci(ai): Route AI integration tests through OpenRouter sentry-python#6979 (workflow ai-integration-test.yml)
sentry-javascript: no testing-ai-sdk-integrations caller workflow found
ab-test-gha: stale demo/fixture only, not a production caller

Secrets needed

getsentry/testing-ai-sdk-integrations repo secret: OPENROUTER_API_KEY (for daily/PR workflows)
getsentry/sentry-python environment secret on AI Integrations Tests: OPENROUTER_API_KEY
After both merge, drop ANTHROPIC_API_KEY from those places

Requested by Daniel Griesser.

Co-Authored-By: Daniel Griesser <dgriesser@sentry.io>

github-actions · 2026-07-31T11:48:26Z

🟡 AI SDK Integration Test Results

Status: 432 tests failing (no regressions)

Summary

Metric	main	PR	Change
Total Tests	847	847	—
Passed	139	139	—
Failed	432	432	—

Test Matrix

Agent Tests

SDK	Basic Agent Test	Conversation ID Agent Test	Long Input Agent Test	Tool Call Agent Test	Tool Error Agent Test	Vision Agent Test
cloudflare/langgraph	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai
cloudflare/vercel	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}
nextjs/mastra	❌	❌	—	❌	❌	❌
nextjs/vercel	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}
node/langgraph	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai	❌_anthropic ❌_openai
node/manual	✅	✅	✅	✅	✅	✅
node/mastra	❌	❌	❌	❌	❌	❌
node/vercel	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}	❌_{blk, class, anthropic} ❌_{blk, class, openai} ❌_{blk, function, anthropic} ❌_{blk, function, openai} ❌_{str, class, anthropic} ❌_{str, class, openai} ❌_{str, function, anthropic} ❌_{str, function, openai}
python/langgraph	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}	❌_{a, anthropic} ❌_{a, openai} ❌_{s, anthropic} ❌_{s, openai}
python/manual	✅_a ✅_s	✅_a ✅_s	✅_a ✅_s	✅_a ✅_s	✅_a ✅_s	✅_a ✅_s
python/openai-agents	❌	❌	❌	❌	❌	❌
python/pydantic-ai	❌_{a, fallback} ❌_{a, single}	❌_{a, fallback} ❌_{a, single}	❌_{a, fallback} ❌_{a, single}	❌_{a, fallback} ❌_{a, single}	❌_{a, fallback} ❌_{a, single}	❌_{a, fallback} ❌_{a, single}

Embedding Tests

SDK	Basic Embeddings Test
browser/google-genai	✅
browser/langchain	✅
browser/openai	✅
cloudflare/google-genai	❌
cloudflare/langchain	❌
cloudflare/openai	❌
cloudflare/vercel	❌
nextjs/google-genai	✅
nextjs/langchain	✅
nextjs/openai	✅
nextjs/vercel	❌
node/google-genai	✅
node/langchain	✅
node/openai	✅
node/vercel	❌
python/google-genai	✅_{a, blk} ✅_{s, blk}
python/langchain	❌_{a, blk} ❌_{s, blk}
python/litellm	❌_{a, blk} ✅_{s, blk}
python/manual	✅_{a, blk} ✅_{s, blk}
python/openai	✅_{a, blk} ✅_{s, blk}

LLM Tests

SDK	Basic Error LLM Test	Basic LLM Test	Conversation ID LLM Test	Long Input LLM Test	Multi-Turn LLM Test	Vision LLM Test
browser/anthropic	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
browser/google-genai	✅_blk ✅_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
browser/langchain	❌_{blk, anthropic} ✅_{blk, openai} ❌_{str, anthropic} ✅_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}
browser/openai	✅_{blk, chat} ✅_{blk, responses} ✅_{str, chat} ✅_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}
cloudflare/anthropic	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
cloudflare/google-genai	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
cloudflare/langchain	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}
cloudflare/openai	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}
nextjs/anthropic	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
nextjs/google-genai	✅_blk ✅_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
nextjs/langchain	❌_{blk, anthropic} ✅_{blk, openai} ❌_{str, anthropic} ✅_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}
nextjs/openai	✅_{blk, chat} ✅_{blk, responses} ✅_{str, chat} ✅_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}
node/anthropic	✅_blk ✅_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
node/google-genai	✅_blk ✅_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str	❌_blk ❌_str
node/langchain	❌_{blk, anthropic} ✅_{blk, openai} ❌_{str, anthropic} ✅_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}	❌_{blk, anthropic} ❌_{blk, openai} ❌_{str, anthropic} ❌_{str, openai}
node/manual	—	✅	✅	✅	✅	✅
node/openai	✅_{blk, chat} ✅_{blk, responses} ✅_{str, chat} ✅_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}	❌_{blk, chat} ❌_{blk, responses} ❌_{str, chat} ❌_{str, responses}
python/anthropic	✅_{a, blk} ✅_{a, str} ✅_{s, blk} ✅_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}
python/google-genai	✅_{a, blk} ✅_{a, str} ✅_{s, blk} ✅_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}	❌_{a, blk} ❌_{a, str} ❌_{s, blk} ❌_{s, str}
python/langchain	✅_{a, blk, anthropic} ✅_{a, blk, openai} ✅_{a, str, anthropic} ✅_{a, str, openai} ✅_{s, blk, anthropic} ✅_{s, blk, openai} ✅_{s, str, anthropic} ✅_{s, str, openai}	❌_{a, blk, anthropic} ❌_{a, blk, openai} ❌_{a, str, anthropic} ❌_{a, str, openai} ❌_{s, blk, anthropic} ❌_{s, blk, openai} ❌_{s, str, anthropic} ❌_{s, str, openai}	❌_{a, blk, anthropic} ❌_{a, blk, openai} ❌_{a, str, anthropic} ❌_{a, str, openai} ❌_{s, blk, anthropic} ❌_{s, blk, openai} ❌_{s, str, anthropic} ❌_{s, str, openai}	❌_{a, blk, anthropic} ❌_{a, blk, openai} ❌_{a, str, anthropic} ❌_{a, str, openai} ❌_{s, blk, anthropic} ❌_{s, blk, openai} ❌_{s, str, anthropic} ❌_{s, str, openai}	❌_{a, blk, anthropic} ❌_{a, blk, openai} ❌_{a, str, anthropic} ❌_{a, str, openai} ❌_{s, blk, anthropic} ❌_{s, blk, openai} ❌_{s, str, anthropic} ❌_{s, str, openai}	❌_{a, blk, anthropic} ❌_{a, blk, openai} ❌_{a, str, anthropic} ❌_{a, str, openai} ❌_{s, blk, anthropic} ❌_{s, blk, openai} ❌_{s, str, anthropic} ❌_{s, str, openai}
python/litellm	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}	❌_{a, blk, completion, anthropic} ❌_{a, blk, completion, openai} ❌_{a, blk, responses, anthropic} ❌_{a, blk, responses, openai} ❌_{a, str, completion, anthropic} ❌_{a, str, completion, openai} ❌_{a, str, responses, anthropic} ❌_{a, str, responses, openai} ❌_{s, blk, completion, anthropic} ❌_{s, blk, completion, openai} ❌_{s, blk, responses, anthropic} ❌_{s, blk, responses, openai} ❌_{s, str, completion, anthropic} ❌_{s, str, completion, openai} ❌_{s, str, responses, anthropic} ❌_{s, str, responses, openai}
python/manual	—	✅_{a, blk} ✅_{s, blk}	✅_{a, blk} ✅_{s, blk}	✅_{a, blk} ✅_{s, blk}	✅_{a, blk} ✅_{s, blk}	✅_{a, blk} ✅_{s, blk}
python/openai	✅_{a, blk, chat} ✅_{a, blk, responses} ✅_{a, str, chat} ✅_{a, str, responses} ✅_{s, blk, chat} ✅_{s, blk, responses} ✅_{s, str, chat} ✅_{s, str, responses}	❌_{a, blk, chat} ❌_{a, blk, responses} ❌_{a, str, chat} ❌_{a, str, responses} ❌_{s, blk, chat} ❌_{s, blk, responses} ❌_{s, str, chat} ❌_{s, str, responses}	❌_{a, blk, chat} ❌_{a, blk, responses} ❌_{a, str, chat} ❌_{a, str, responses} ❌_{s, blk, chat} ❌_{s, blk, responses} ❌_{s, str, chat} ❌_{s, str, responses}	❌_{a, blk, chat} ❌_{a, blk, responses} ❌_{a, str, chat} ❌_{a, str, responses} ❌_{s, blk, chat} ❌_{s, blk, responses} ❌_{s, str, chat} ❌_{s, str, responses}	❌_{a, blk, chat} ❌_{a, blk, responses} ❌_{a, str, chat} ❌_{a, str, responses} ❌_{s, blk, chat} ❌_{s, blk, responses} ❌_{s, str, chat} ❌_{s, str, responses}	❌_{a, blk, chat} ❌_{a, blk, responses} ❌_{a, str, chat} ❌_{a, str, responses} ❌_{s, blk, chat} ❌_{s, blk, responses} ❌_{s, str, chat} ❌_{s, str, responses}

MCP Tests

SDK	Basic MCP Tool Call Test	MCP Multiple Tool Calls Test	MCP Prompt Get Test	MCP Resource Read Test	MCP Tool Error Test
node/mcp	✅_sse ✅_io	✅_sse ✅_io	✅_sse ✅_io	✅_sse ✅_io	✅_sse ✅_io
python/fastmcp	✅_{a, blk, sse} ✅_{a, blk, io}	✅_{a, blk, sse} ✅_{a, blk, io}	✅_{a, blk, sse} ✅_{a, blk, io}	✅_{a, blk, sse} ✅_{a, blk, io}	✅_{a, blk, sse} ✅_{a, blk, io}
python/mcp	✅_{a, blk, sse, hi} ✅_{a, blk, sse, lo} ✅_{a, blk, io, hi} ✅_{a, blk, io, lo}	✅_{a, blk, sse, hi} ✅_{a, blk, sse, lo} ✅_{a, blk, io, hi} ✅_{a, blk, io, lo}	✅_{a, blk, sse, hi} ✅_{a, blk, sse, lo} ✅_{a, blk, io, hi} ✅_{a, blk, io, lo}	✅_{a, blk, sse, hi} ✅_{a, blk, sse, lo} ✅_{a, blk, io, hi} ✅_{a, blk, io, lo}	✅_{a, blk, sse, hi} ✅_{a, blk, sse, lo} ✅_{a, blk, io, hi} ✅_{a, blk, io, lo}

Generated by AI SDK Integration Tests

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit fd9d21f. Configure here.}

cursor · 2026-07-31T17:57:45Z

+const anthropic = createAnthropic({
+  apiKey: process.env.OPENROUTER_API_KEY,
+  baseURL: "https://openrouter.ai/api",
+});


Wrong Vercel OpenRouter base URL

High Severity

@ai-sdk/anthropic treats baseURL as already versioned (default https://api.anthropic.com/v1) and appends /messages directly. Using https://openrouter.ai/api sends requests to /api/messages instead of /api/v1/messages, so Anthropic Vercel AI SDK tests fail against OpenRouter.

Additional Locations (2)

src/runner/templates/agents/nextjs/vercel/template.njk#L27-L31

src/runner/templates/agents/cloudflare/vercel/template.njk#L45-L49

^{Reviewed by Cursor Bugbot for commit fd9d21f. Configure here.}

Wire the AI integration harness caller to OpenRouter so Anthropic-compatible tests no longer need a direct Anthropic key. **Action input** `.github/workflows/ai-integration-test.yml` now passes `openrouter-api-key: ${{ secrets.OPENROUTER_API_KEY }}` instead of `anthropic-api-key`. The harness remains pinned to the merged OpenRouter migration revision (`318143d106d4a847dfac3804bb2663d1b852cf28`) for pipeline stability and supply-chain safety. Companion: getsentry/testing-ai-sdk-integrations#154 **Secrets** This workflow uses the `AI Integrations Tests` environment. Add `OPENROUTER_API_KEY` there (environment secret), not only as a plain repo secret, then `ANTHROPIC_API_KEY` can be removed after this ships. --------- Co-authored-by: sentry-junior[bot] <264270552+sentry-junior[bot]@users.noreply.github.com> Co-authored-by: Daniel Griesser <dgriesser@sentry.io>

ci(ai): Route Anthropic tests through OpenRouter

fd9d21f

Co-Authored-By: Daniel Griesser <dgriesser@sentry.io>

sentry-junior Bot mentioned this pull request Jul 31, 2026

ci(ai): Route AI integration tests through OpenRouter getsentry/sentry-python#6979

Merged

HazAT marked this pull request as ready for review July 31, 2026 17:53

HazAT merged commit 318143d into main Jul 31, 2026
14 of 15 checks passed

cursor Bot reviewed Jul 31, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

ci(ai): Route Anthropic tests through OpenRouter - #154

ci(ai): Route Anthropic tests through OpenRouter#154
HazAT merged 1 commit into
mainfrom
feat/route-anthropic-through-openrouter

sentry-junior Bot commented Jul 31, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Jul 31, 2026

Uh oh!

Uh oh!

cursor Bot left a comment

Uh oh!

cursor Bot Jul 31, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Uh oh!

Conversation

sentry-junior Bot commented Jul 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jul 31, 2026

🟡 AI SDK Integration Test Results

Summary

Test Matrix

Agent Tests

Embedding Tests

LLM Tests

MCP Tests

Uh oh!

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cursor Bot Jul 31, 2026

Choose a reason for hiding this comment

Wrong Vercel OpenRouter base URL

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

sentry-junior Bot commented Jul 31, 2026 •

edited

Loading