sdk use Case

[yolk23321]

I want to use Openlit to monitor the API calls of Gemini, but I couldn't find a complete example code. Could you provide me with one? I hope the official documentation can be supplemented with more detailed examples for the SDK

[patcher9]

i can help you, are you using vertex ai or google ai studio?

[yolk23321]

google ai studio

[patcher9]

Here is an example, This will print all traces and metrics directly to you console. If you need to send this to an OTel backend and store the traces and metrics for analysis, You can refer this

import google.generativeai as genai
import openlit

# Initialize environment and application name for OpenLIT monitoring
openlit.init(environment="testing", application_name="test")

# Initialize Google AI Studio client
genai.configure(api_key=os.getenv("GOOGLE_AI_STUDIO_API_TOKEN"))
model = genai.GenerativeModel("gemini-1.5-flash")

response = model.generate_content("Observability for LLMs", stream=False)

# streaming response
response = model.generate_content("Monitor AI", stream=True)
for text in response:
    assert isinstance(text.text, str)

[patcher9]

@yolk23321 lemme know if you have any issues that I can help with