-
Notifications
You must be signed in to change notification settings - Fork 104
Labels
enhancementNew feature or requestNew feature or request
Description
Add support for LiteLLM in the llm/response_api.py for better extensibility and maintainability of newer LLMs.
- Add new Model class for LiteLLM similar to ChatCompletionModel.
- Include support for anthropic related parameters (cache_breakpoints etc).
- Include other parameters like (reasoning effort) etc.
- Add cost tracking in
tracking.pyfor litellm and use litellm helper functions. - Write tests using 'mock' param of liteLMM completion.
- Test function calling support.
- Replicate OAI/Anthropic Agents using LiteLLM and compare outputs.
HenryPengZou
Sub-issues
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request