Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature request] Cerebras Auto-Instrumentation #1059

Open
exiao opened this issue Oct 11, 2024 · 2 comments
Open

[feature request] Cerebras Auto-Instrumentation #1059

exiao opened this issue Oct 11, 2024 · 2 comments
Labels
backlog enhancement New feature or request language: python Related to Python integration

Comments

@exiao
Copy link

exiao commented Oct 11, 2024

Is your feature request related to a problem? Please describe.
I'd like an auto-instrumentation for Cerebras.ai, which is very similar to Groq. I use cerebras with instructor, and without auto-instrumentation, I cannot use instructor's auto instrumentation and must manually log fields to phoenix.

http://cerebras.ai/inference
https://inference-docs.cerebras.ai/introduction
https://python.useinstructor.com/blog/2024/10/15/introducing-structured-outputs-with-cerebras-inference/

Describe the solution you'd like
Add an auto-instrumentation during setup of my application, similar to Grow.

Describe alternatives you've considered
I currently manually instrument by specifying attributes on the span

@exiao exiao added enhancement New feature or request triage Issues that require triage labels Oct 11, 2024
@github-project-automation github-project-automation bot moved this to 📘 Todo in phoenix Oct 11, 2024
@dosubot dosubot bot added the language: python Related to Python integration label Oct 11, 2024
@axiomofjoy
Copy link
Contributor

axiomofjoy commented Oct 11, 2024

@exiao It looks like Cerebras is compatible with OpenAI's client library. Can you try using the OpenAI client with openinference-instrumentation-openai and see if that works?

https://inference-docs.cerebras.ai/openai#configuring-openai-to-use-cerebras-api

@mikeldking
Copy link
Contributor

Agree let's try to push of using openai SDK for now. Moving to backlog

@mikeldking mikeldking added backlog and removed triage Issues that require triage labels Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog enhancement New feature or request language: python Related to Python integration
Projects
Status: 📘 Todo
Development

No branches or pull requests

3 participants