Azure Mgmt Arizeaiobservabilityeval Dotnet

What it does

This skill provides programmatic access to the Azure Arize AI Observability Evaluation service using a .NET client library. It allows agents to manage evaluation jobs, retrieve results, and interact with other resources within the Arize observability platform directly through code. This enables automated analysis and reporting of model performance metrics in Azure.

When to use it

• Automate the creation and execution of evaluation jobs for machine learning models deployed on Azure.
• Retrieve and analyze evaluation results programmatically, integrating them into dashboards or reports.
• Manage and configure resources within your Arize AI Observability Evaluation environment.
• Build custom tooling around model performance monitoring and analysis in Azure.

Key capabilities

• Management of evaluation jobs
• Retrieval of evaluation results
• Interaction with Arize AI Observability Evaluation resources
• Utilizes the .NET client library for Azure

Example prompts

• "Create an evaluation job to assess model drift on my latest deployment."
• "Retrieve the performance metrics for the 'production' evaluation job."
• "List all available evaluation jobs in my Arize account."

Tips & gotchas

• Requires appropriate Azure credentials and permissions to access the Arize AI Observability Evaluation service.
• Familiarity with .NET programming is beneficial for leveraging this skill effectively.