Azure Mgmt Arizeaiobservabilityeval Dotnet

What it does

This skill provides access to the Azure Management library for Arize AI Observability Evaluation using .NET. It allows agents to interact with and manage Arize observability data within an Azure environment, enabling automated evaluation workflows and integration with existing Azure infrastructure. Specifically, this includes functionalities related to evaluating model performance metrics stored in Arize.

When to use it

• Automate the creation of new evaluations in Arize based on triggers from Azure events (e.g., a new model deployment).
• Retrieve specific evaluation results from Arize for reporting or further analysis within an Azure environment.
• Integrate Arize observability data into existing .NET-based dashboards and monitoring systems hosted on Azure.
• Manage user access and permissions related to Arize evaluations programmatically through the Azure interface.

Key capabilities

• Azure Management Library integration
• Arize AI Observability Evaluation support
• .NET language support
• Automated evaluation workflows

Example prompts

• "Create a new Arize evaluation for model 'my-model' with dataset 'production_data'."
• "Retrieve the latest performance metrics for the 'sentiment-analysis' evaluation in Arize."
• "List all users with access to the 'fraud-detection' Arize workspace."

Tips & gotchas

• Requires appropriate Azure credentials and permissions to interact with both Azure and Arize.
• Familiarity with .NET programming concepts is beneficial for leveraging this skill effectively.