Skip to content
TrustedSkillsbeta
Back to all skills

Aws Bedrock Evals

Listed
antstackio·vlatest·cloud

Provides AWS guidance and assistance for deploying and managing cloud infrastructure.

Repository

Install on your platform

This skill no longer installs under the name aws-bedrock-evals. antstackio/skills is deleted or private, so it cannot be installed from.

We check each listing against its upstream repository with the rules the skills CLI uses, last on 2026-10-22. We don't show a command we know will fail.

Repository install instructions

What we know about this skill

Publisher

antstackio

Taken from the source listing. We haven't verified who controls this account.

Install target

Live repository

Not pinned. Installing fetches whatever the repository holds at the time you run the command.

Nobody has reviewed this code. TrustedSkills indexes and links skills; it does not audit, run or scan them. A skill runs with whatever access you give your agent — read the source before you install it.

Automated safety checks

scanned

We could not read this skill's source, so none of the checks below were run.

Not scanned. repository not found or private Source recorded as antstackio/skills.
This is a static scan, not a review. It reads the skill's files; it does not run them, and it cannot tell you whether the skill is any good or whether the code does what its description says. A skill runs with whatever access you give your agent.
What each check looks for →

About this skill

What it does

This skill allows AI agents to evaluate models deployed on AWS Bedrock. It provides a mechanism for assessing model performance based on predefined metrics and datasets, enabling users to track quality over time and compare different models. The skill facilitates automated evaluation workflows within an agent's operational pipeline.

When to use it

  • Model Selection: Compare the performance of multiple foundation models available through Bedrock before committing to a specific one for your application.
  • Continuous Monitoring: Regularly evaluate deployed models to detect degradation in performance due to data drift or other factors.
  • A/B Testing: Evaluate different model versions or configurations against each other to optimize for specific metrics.
  • Automated Reporting: Generate reports on model evaluation results, providing insights into model health and potential areas for improvement.

Key capabilities

  • Evaluates models deployed on AWS Bedrock.
  • Uses predefined metrics for assessment.
  • Leverages datasets for evaluation.
  • Supports automated evaluation workflows.

Example prompts

  • "Evaluate the 'anthropic.claude-v2' model using the provided dataset and report accuracy."
  • "Run a performance comparison between 'cohere.command-text-v14' and 'meta.llama2-13b-chat' on the sentiment analysis benchmark."
  • “Generate a weekly report of evaluation metrics for all deployed models.”

Tips & gotchas

  • Requires appropriate AWS credentials configured within the agent environment to access Bedrock resources.
  • The accuracy of evaluations depends heavily on the quality and relevance of the chosen datasets.