[Docs]: AI21 Monitoring with OpenTelemetry

[patcher9]

Is your feature request related to a problem? Please describe.
There is no Documentation or blog guide for monitoring AI21 usage (cost, tokens, interactions)

Describe the solution you'd like
Add a Documentation or blog guide for monitoring AI21 usage (cost, tokens, interactions)

Describe alternatives you've considered
Refer users using AI21 and looking for Observability with OpenTelemetry to https://docs.openlit.io/latest/integrations/ai21

Additional context
Hi Team, I am one of the maintainers of OpenLIT and we support Observability for LLM apps built using AI21, It is all OpenTelemetry-native so the traces and metrics can be sent to any platform like Grafana or any OSS OTel tools

OpenLIT helps when the users are using LLM + VectorDBs + Other framework actions as the consolidated monitoring gives them a complete picture. Plus since its OpenTelemetry which a lot of people are looking to use.

I wanted to figure out a way to share this information to AI21 users especially the ones using python SDK. I was looking to add a guide in docs or a blog, Can someone help me with a process?

[Josephasafg]

Hey @patcher9!

I wanted to share that our documentation on usage and pricing provides detailed information on how our platform's usage and pricing are structured.

Additionally, our API Reference Documentation includes a usage property, which should contain the data you are seeking.

Could you please elaborate on the type of blog guide you are considering? Is there any specific information or feature you feel is missing?

Thanks!

[patcher9]

Hey @Josephasafg

The documentation or blog guide I am talking about is for Observability (Developers use the observability data for analytics on how to improve the LLM Application in the long term). API reponse has usage attributes but most developers want to track this information and thats why this doc/blog

This is an example of observability guide from CrewAI - https://docs.crewai.com/how-to/openlit-observability

[patcher9]

Hey @Josephasafg any suggestions on how I can contribute a documentation or blog guide? I can share a draft over email if you prefer

[Josephasafg]

@patcher9 Can you please send an email to our support with your suggestion and your ideas and they'll take it from there?

Email address is - [email protected]

Thank you!