Agent Evaluation
Evaluates Tavi Agency agents' performance against defined metrics, providing actionable feedback for improvement.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add tavi-agency-agent-evaluation npx -- -y @trustedskills/tavi-agency-agent-evaluation
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"tavi-agency-agent-evaluation": {
"command": "npx",
"args": [
"-y",
"@trustedskills/tavi-agency-agent-evaluation"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
This skill, tavi-agency-agent-evaluation, provides a mechanism for evaluating the performance of AI agents. It assesses agent behavior and outputs structured feedback based on predefined criteria. The evaluation results can be used to identify areas for improvement in agent design or training.
When to use it
- Debugging Agent Behavior: After an agent exhibits unexpected actions, use this skill to diagnose the root cause.
- Performance Benchmarking: Regularly evaluate agents against a standardized set of tasks to track progress and compare different versions.
- Training Data Validation: Assess how well an agent generalizes to new scenarios after training on a specific dataset.
- Agent Comparison: Evaluate multiple agents performing similar tasks to determine which performs best based on defined metrics.
Key capabilities
- Structured feedback generation
- Assessment of agent behavior
- Evaluation against predefined criteria
- Performance benchmarking
Example prompts
- "Evaluate the agent's response to this user query: 'What is the capital of France?'"
- "Assess the agent’s performance in completing task X, focusing on efficiency and accuracy."
- "Provide feedback on the agent’s interaction with the user during scenario Y."
Tips & gotchas
The skill's effectiveness depends on clearly defined evaluation criteria. Ensure these are specific and measurable for accurate assessment.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.