The latest Azure AI Inference Python has been released with their tracing package: https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/ai/azure-ai-inference#tracing.

After taking a dependency on their tracing package, we will no longer need to instrument the Azure AI Inference with our own model diagnostics module anymore. A sample can be found here: https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-inference/samples/sample_chat_completions_with_tracing.py

• Take a dependency on the tracing package
• Add sample and possibly a blog post
• Notify the Azure AI Inference team