Support for Gemini Endpoint for Guardrails

[rajatm91]

Hello,

We are currently exploring the guardrails feature in OpenLIT and noticed that it presently supports only Anthropic and OpenAI endpoints. Given that Gemini endpoints are now OpenAI-compatible, are there any plans to extend support to Gemini endpoints as well?

Thank you.

[jaiswalvineet]

as I am on GCP, this is very important feature which I am looking for, waiting for reply on this thread

[patcher9]

We use the OpenAI SDK but also allow you to pass a different base_url in the parameters.

Reference Documentation - https://docs.openlit.io/latest/features/guardrails#openlit-guard-promptinjection-class-parameters

Do you think this would work for you?

[rajatm91]

Yeah I think that should work.

[patcher9]

Update: Planning on use LiteLLM so that devs can use any LLM, What do you think, Would that work even better for you?