Skip to content

docs: Update major LLM provider integrations for Model Catalog

35ac4b1
Select commit
Loading
Failed to load commit list.
Open

Model Catalog Migration 8A/9: Extended LLM Provider Integration (Major Providers) #697

docs: Update major LLM provider integrations for Model Catalog
35ac4b1
Select commit
Loading
Failed to load commit list.
Mintlify / Mintlify Deployment succeeded Feb 4, 2026 in 40s

Deployment Succeeded

Details

Verified update permissions
Fetching and validating config file...
Successfully validated docs.json
Fetching .mintignore file...
No .mintignore file found
file too large - skipping: images/autogen/autogen-1.gif
file too large - skipping: images/autogen/autogen-2.gif
file too large - skipping: images/autogen/autogen-3.gif
file too large - skipping: images/autogen/autogen-4.gif
file too large - skipping: images/autogen/autogen-5.gif
file too large - skipping: images/changelog/model-catalog.mp4
file too large - skipping: images/libraries/dspy-traces.gif
file too large - skipping: images/product/ai-gateway/ai-32.gif
file too large - skipping: images/product/ai-gateway/saved-filters.gif
file too large - skipping: images/product/metadata-logs.gif
file too large - skipping: images/product/saved-filters.gif
Fetched all file paths
Fetched 2 OpenApi file(s):
  - openapi/portkey-models.json
  - https://raw.githubusercontent.com/Portkey-AI/openapi/refs/heads/master/openapi.yaml
Fetched 0 AsyncApi file(s)
Skipped OpenAPI navigation generation
Skipped AsyncAPI navigation generation
Successfully updated API reference metadata.
No stale files found
Updating targeted paths:
  integrations/llms/anthropic.mdx
  integrations/llms/gemini.mdx
  integrations/llms/openai.mdx
  integrations/llms/openai/prompt-caching-openai.mdx
  integrations/llms/openai3.mdx
  integrations/llms/vertex-ai.mdx
  integrations/llms/vertex-ai/batches.mdx
  integrations/llms/vertex-ai/files.mdx
  integrations/llms/vertex-ai/fine-tuning.mdx
Successfully updated deployment
LaTeX configuring is unchanged
Successfully saved config
Identified 20 stale tracked asset(s)
Updating navigation...
Navigation updated
Updating hidden pages noindex...
Updated 0 hidden page(s) with noindex
Skipped search indexing.
Successfully deleted stale OpenAPI document(s)
Successfully deleted stale AsyncAPI document(s)
Cached valid paths
Starting page revalidation...
Revalidating all pages...
Revalidating paths:
  integrations/llms/anthropic
  integrations/llms/gemini
  integrations/llms/openai
  integrations/llms/openai/prompt-caching-openai
  integrations/llms/openai3
  integrations/llms/vertex-ai
  integrations/llms/vertex-ai/batches
  integrations/llms/vertex-ai/files
  integrations/llms/vertex-ai/fine-tuning
  /integrations/observability-integrations
  /integrations/tracing-providers
  /changelog/enterprise/oct-24
  /changelog/product/oct-24
  /api-reference
  /api-reference/introduction
  /api-reference/authentication
  /api-reference/headers
  /api-reference/config-object
  /api-reference/portkey-sdk-client
  /provider-endpoints/supported-providers
  /api-reference/response-schema
  /provider-endpoints
  /provider-endpoints/assistants-api/assistants/create-assistant
  /provider-endpoints/assistants-api/assistants/delete-assistant
  /provider-endpoints/assistants-api/assistants/list-assistants
  /provider-endpoints/assistants-api/assistants/modify-assistant
  /provider-endpoints/assistants-api/assistants/retrieve-assistant
  /provider-endpoints/assistants-api/assistants
  /provider-endpoints/assistants-api/messages/create-message
  /provider-endpoints/assistants-api/messages/delete-message
  /provider-endpoints/assistants-api/messages/list-messages
  /provider-endpoints/assistants-api/messages/modify-message
  /provider-endpoints/assistants-api/messages/retrieve-message
  /provider-endpoints/assistants-api/messages
  /provider-endpoints/assistants-api/run-steps/list-run-steps
  /provider-endpoints/assistants-api/run-steps/retrieve-run-steps
  /provider-endpoints/assistants-api/run-steps
  /provider-endpoints/assistants-api/runs/cancel-run
  /provider-endpoints/assistants-api/runs/create-run
  /provider-endpoints/assistants-api/runs/create-thread-and-run
  /provider-endpoints/assistants-api/runs/list-runs
  /provider-endpoints/assistants-api/runs/modify-run
  /provider-endpoints/assistants-api/runs/retrieve-run
  /provider-endpoints/assistants-api/runs/submit-tool-outputs-to-run
  /provider-endpoints/assistants-api/runs
  /provider-endpoints/assistants-api/threads/create-thread
  /provider-endpoints/assistants-api/threads/delete-thread
  /provider-endpoints/assistants-api/threads/modify-thread
  /provider-endpoints/assistants-api/threads/retrieve-thread
  /provider-endpoints/assistants-api/threads
  /provider-endpoints/assistants-api
  /provider-endpoints/audio/create-speech
  /provider-endpoints/audio/create-transcription
  /provider-endpoints/audio/create-translation
  /provider-endpoints/audio
  /provider-endpoints/batch/cancel-batch
  /provider-endpoints/batch/create-batch
  /provider-endpoints/batch/list-batch
  /provider-endpoints/batch/retrieve-batch
  /provider-endpoints/batch
  /provider-endpoints/chat
  /provider-endpoints/completions
  /provider-endpoints/embeddings
  /provider-endpoints/files/delete-file
  /provider-endpoints/files/list-files
  /provider-endpoints/files/retrieve-file-content
  /provider-endpoints/files/retrieve-file
  /provider-endpoints/files/upload-file
  /provider-endpoints/files
  /provider-endpoints/fine-tuning/cancel-fine-tuning
  /provider-endpoints/fine-tuning/create-fine-tuning-job
  /provider-endpoints/fine-tuning/list-fine-tuning-checkpoints
  /provider-endpoints/fine-tuning/list-fine-tuning-events
  /provider-endpoints/fine-tuning/list-fine-tuning-jobs
  /provider-endpoints/fine-tuning/retrieve-fine-tuning-job
  /provider-endpoints/fine-tuning
  /provider-endpoints/gateway-for-other-apis
  /provider-endpoints/images/create-image-edit
  /provider-endpoints/images/create-image-variation
  /provider-endpoints/images/create-image
  /provider-endpoints/images
  /provider-endpoints/moderations
  /portkey-endpoints
  /portkey-endpoints/admin/user-invites/delete-a-user-invite
  /portkey-endpoints/admin/user-invites/invite-a-user
  /portkey-endpoints/admin/user-invites/retrieve-all-user-invites
  /portkey-endpoints/admin/user-invites/retrieve-an-invite
  /portkey-endpoints/admin/users/remove-a-user
  /portkey-endpoints/admin/users/retrieve-a-user
  /portkey-endpoints/admin/users/retrieve-all-users
  /portkey-endpoints/admin/users/update-a-user
  /portkey-endpoints/admin/workspace-members/add-a-workspace-member
  /portkey-endpoints/admin/workspace-members/remove-workspace-member
  /portkey-endpoints/admin/workspace-members/retrieve-a-workspace-member
  /portkey-endpoints/admin/workspace-members/retrieve-all-workspace-members
  /portkey-endpoints/admin/workspace-members/update-workspace-member
  /portkey-endpoints/admin/workspaces/create-workspace
  /portkey-endpoints/admin/workspaces/delete-a-workspace
  /portkey-endpoints/admin/workspaces/retrieve-a-workspace
  /portkey-endpoints/admin/workspaces/retrieve-all-workspaces
  /portkey-endpoints/admin/workspaces/update-workspace
  /portkey-endpoints/analytics/graphs-time-series-data/get-cache-hit-latency-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-cache-hit-rate-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-cost-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-error-rate-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-errors-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-feedback-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-feedback-per-ai-models
  /portkey-endpoints/analytics/graphs-time-series-data/get-feedback-score-distribution-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-latency-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-requests-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-requests-per-user
  /portkey-endpoints/analytics/graphs-time-series-data/get-rescued-requests-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-status-code-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-tokens-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-unique-status-code-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-users-data
  /portkey-endpoints/analytics/graphs-time-series-data/get-weighted-feeback-data
  /portkey-endpoints/analytics/groups-paginated-data/get-metadata-grouped-data
  /portkey-endpoints/analytics/groups-paginated-data/get-model-grouped-data
  /portkey-endpoints/analytics/groups-paginated-data/get-user-grouped-data
  /portkey-endpoints/analytics/summary/get-all-cache-data
  /portkey-endpoints/api-keys/create-api-key
  /portkey-endpoints/api-keys/delete-an-api-key
  /portkey-endpoints/api-keys/list-api-keys
  /portkey-endpoints/api-keys/retrieve-an-api-key
  /portkey-endpoints/api-keys/update-api-key
  /portkey-endpoints/configs/create-config
  /portkey-endpoints/configs/list-configs
  /portkey-endpoints/configs/retrieve-config
  /portkey-endpoints/configs/update-config
  /portkey-endpoints/feedback/create-feedback
  /docs/portkey-endpoints/feedback/create-feedback
  /portkey-endpoints/feedback/update-feedback
  /docs/portkey-endpoints/feedback/update-feedback
  /portkey-endpoints/guardrails
  /docs/portkey-endpoints/logs/insert-a-log
  /portkey-endpoints/logs/insert-a-log
  /portkey-endpoints/logs/log-exports-beta/cancel-a-log-export
  /portkey-endpoints/logs/log-exports-beta/create-a-log-export
  /portkey-endpoints/logs/log-exports-beta/download-a-log-export
  /portkey-endpoints/logs/log-exports-beta/list-log-exports
  /portkey-endpoints/logs/log-exports-beta/retrieve-a-log-export
  /portkey-endpoints/logs/log-exports-beta/start-a-log-export
  /portkey-endpoints/logs/log-exports-beta/update-a-log-export
  /portkey-endpoints/prompts/prompt-completion
  /portkey-endpoints/prompts/render
  /portkey-endpoints/virtual-keys/create-virtual-key
  /portkey-endpoints/virtual-keys/delete-virtual-key
  /portkey-endpoints/virtual-keys/list-virtual-keys
  /portkey-endpoints/virtual-keys/retrieve-virtual-key
  /portkey-endpoints/virtual-keys/update-virtual-key
  /product/observability-modern-monitoring-for-llms
  /product/observability-modern-monitoring-for-llms/:slug*
  /product/guardrails/list-of-guardrail-checks/:slug*
  /product/ai-gateway-streamline-llm-integrations
  /product/ai-gateway-streamline-llm-integrations/:slug*
  /welcome/agents
  /welcome/agents/:slug*
  /welcome/integration-guides
  /welcome/integration-guides/:slug*
  /key-features/prompt-management#versioning-of-prompts
  /introduction/welcome-to-portkey
  /introduction/getting-started
  /introduction/features
  /introduction/portkey-headers
  /portkey-features/ai-gateway
  /portkey-features/ai-gateway/:slug*
  /portkey-features/ai-gateway/configs
  /portkey-features/ai-gateway/simple-and-semantic-cache
  /portkey-features/ai-gateway/fallbacks-on-llms
  /portkey-features/observability
  /portkey-features/observability/logs-and-analytics
  /portkey-features/observability/request-tracing
  /portkey-features/observability/custom-metadata
  /portkey-features/model-management
  /portkey-features/feedback
  /portkey-features/security-and-compliance
  /portkey-features/security-and-compliance/virtual-keys
  /portkey-features/continuous-fine-tuning-beta
  /sdk
  /sdk/python
  /sdk/node
  /integrations
  /integrations/llm-providers
  /integrations/llm-providers/open-ai-sdk
  /integrations/llm-providers/anthropic-sdk
  /integrations/llm-providers/whisper
  /integrations/llm-providers/anyscale-llama-2-and-mistral-7b
  /integrations/llm-providers/anyscale-llama-2-and-mistral-7b/fallback-to-llama2-70b-in-llamaindex
  /integrations/llm-providers/cohere
  /integrations/llamaindex
  /integrations/llamaindex/implementing-fallbacks-and-retries
  /integrations/llamaindex/implementing-load-balancing
  /integrations/llamaindex/implementing-semantic-caching
  /integrations/llamaindex/observability
  /integrations/langchain
  /integrations/rest-api
  /integrations/rest-api/portkey-headers
  /cookbook
  /cookbook/few-shot-prompting
  /support-and-faq/why-portkey
  /support-and-faq/why-portkey/observability
  /support-and-faq/why-portkey/lower-cost-and-latency
  /support-and-faq/why-portkey/improve-llm-success-rate
  /support-and-faq/why-portkey/optimise-generation-quality
  /support-and-faq/why-portkey/hide-pii-from-llms
  /support-and-faq/common-errors-and-resolutions
  /overview/introduction
  /overview/features-overview
  /getting-started/setup-your-account
  /getting-started/quick-integration
  /how-portkey-works/portkey-modes
  /how-portkey-works/portkey-headers
  /how-portkey-works/supported-llms
  /key-features/request-caching
  /key-features/request-tracing
  /key-features/automatic-retries
  /key-features/circuit-breaker
  /key-features/custom-metadata
  /key-features/fallbacks-on-llms
  /key-features/load-balancing
  /key-features/feedback-api
  /key-features/logs-and-analytics
  /key-features/ai-provider-keys
  /key-features/prompt-management
  /key-features/prompt-management/few-shot-prompting
  /integration-guides/open-ai-sdk
  /integration-guides/llamaindex
  /integration-guides/llamaindex/implementing-fallbacks-and-retries
  /integration-guides/llamaindex/implementing-load-balancing
  /integration-guides/llamaindex/implementing-semantic-caching
  /integration-guides/llamaindex/observability
  /integration-guides/langchain
  /integration-guides/cohere
  /integration-guides/anthropic-sdk
  /integration-guides/microsoft-guidance
  /integration-guides/rest-api
  /why-portkey/observability
  /why-portkey/lower-cost-and-latency
  /why-portkey/improve-llm-success-rate
  /why-portkey/optimise-generation-quality
  /why-portkey/hide-pii-from-llms
  /troubleshooting-and-support/common-errors-and-resolutions
  /open-source
  /open-source/rubeus-by-portkey
  /support-and-faq/join-portkey-on-discord
  /support-and-faq/contacting-support
  /support-and-faq/reporting-issues
  /troubleshooting-and-support/reporting-issues
  /troubleshooting-and-support/contacting-support
  /troubleshooting-and-support/join-portkey-on-discord
  /welcome/what-is-portkey
  /welcome/readme
  /welcome/integration-guides/openai
  /welcome/make-your-first-request
  /product/ai-gateway-streamline-llm-integrations/cache-simple-and-semantic
  /welcome/integration-guides/langchain-python
  /welcome/integration-guides/azure-openai
  /api-reference/chat-completions
  /product/ai-gateway-streamline-llm-integrations/virtual-keys
  /welcome/integration-guides/llama-index-python
  /welcome/integration-guides/anthropic
  /api-reference/gateway-for-other-apis
  /welcome/integration-guides/ollama
  /cookbooks/few-shot-prompting
  /welcome/integration-guides/gemini
  product/guardrails/bedrock-guardrials
  /api-reference/prompts
  /welcome/integration-guides/aws-bedrock
  /product/prompt-library/retrieve-prompt-templates
  /api-reference/embeddings
  /api-reference/prompts/prompt-completion
  /api-reference/completions
  /welcome/integration-guides/anyscale-llama2-mistral-zephyr
  /cookbooks/a-b-test-prompts-and-models
  /changelog/portkeys-december-migration
  /portkey-endpoints/configs
  /welcome/integration-guides/autogen
  /api-reference/evals
  /api-reference/feedback
  /cookbooks/function-calling
  /portkey-endpoints/virtual-keys
  /product/ai-gateway-streamline-llm-integrations/virtual-keys/budget-limits-enterprise-feature
  /portkey-endpoints/prompts
  /api-reference/completions-1
  /portkey-endpoints/admin
  /cookbooks/enforcing-json-schema-with-anyscale-and-together
  /api-reference/logs
  /cookbooks/emotions-with-gpt-4o
  /product/ai-gateway-streamline-llm-integrations/multimodal-capabilities/vision-1
  /portkey-endpoints/api-keys
  /portkey-endpoints/analytics/graphs-time-series-data
  /api-reference/virtual-keys
  /guides/practitioners-cookbooks/quickstarts/a-b-test-prompts-and-models
  /portkey-endpoints/logs
  /integrations/llms/openai/structued-outputs
  /portkey-endpoints/analytics
  /portkey-endpoints/analytics/groups-paginated-data
  /portkey-endpoints/admin/workspaces
  /product/enterprise-offering/components/log-store/mongodb
  /portkey-docs/introduction/getting-started
  /api-reference/admin-api/control-plane/admin/:slug*
  /integrations/llms/aws-bedrock
  /product/prompt-library/advanced-prompting-with-json-mode
  /product/prompt-library/prompt-partials
  /product/prompt-library/prompt-templates
  /product/prompt-library/retrieve-prompts
  /product/prompt-library
  /guides/use-cases/build-a-chatbot-using-portkeys-prompt-templates
  /integrations/tools/exa
  /api-reference/inference-api/sdks/supported-sdks
  /api-reference/inference-api/portkey-sdk-client
  /api-reference/inference-api/sdks/c-sharp
  /product/guardrails/aporia
  /product/guardrails/acuvity
  /product/guardrails/azure-guardrails
  /product/guardrails/bedrock-guardrails
  /product/guardrails/lasso
  /product/guardrails/mistral
  /product/guardrails/pangea
  /product/guardrails/patronus-ai
  /product/guardrails/pillar
  /product/guardrails/prompt-security
  /product/guardrails/qualifire
  /product/guardrails/bring-your-own-guardrails
  /product/integrations/models/custom-models
  /pricing/quote
  /product/integrations/model-overrides
  /product/enterprise-offering/private-cloud-deployments/aws
  /product/enterprise-offering/private-cloud-deployments/azure
  /product/enterprise-offering/private-cloud-deployments/gcp
  /product/enterprise-offering/private-cloud-deployments/cloudflare-workers
  /product/enterprise-offering/private-cloud-deployments/f5-app-stack
  /product/enterprise-offering/private-cloud-deployments/architecture
  /product/enterprise-offering/private-cloud-deployments/prometheus-metrics
  /product/enterprise-offering/cloud-marketplace/aws
Page revalidation complete
Successfully deleted stale tracked asset(s)
Queued update of llms-full.txt
Queued update of skill.md
Skipping Vercel revalidation (subdomain not in revalidation list)
Updated Cloudflare deployment cache