Scoring

What it does

The scoring skill provides capabilities to evaluate and assign scores based on given criteria. It can assess text, code, or other data against a defined rubric, providing numerical ratings and potentially justifications for those scores. This allows for automated evaluation of various outputs and performance metrics.

When to use it

• Code Review: Automatically score code submissions based on style guides or functional requirements.
• Content Quality Assessment: Evaluate the quality of generated text (e.g., blog posts, articles) against predefined criteria like clarity, accuracy, and engagement.
• Performance Evaluation: Score agent actions or strategies in a simulated environment to optimize performance.
• Automated Grading: Grade student assignments based on provided rubrics and scoring guidelines.

Key capabilities

• Score text input against defined criteria.
• Assess code quality.
• Provide numerical ratings.

Example prompts

• "Score this Python function for readability and efficiency: [code snippet]"
• "Evaluate this article based on the following rubric: [rubric details]"
• "Assign a score to this email response (1-5) based on politeness and relevance."

Tips & gotchas

The accuracy of scoring depends heavily on the clarity and specificity of the provided criteria. Ensure your rubrics or evaluation guidelines are well-defined for optimal results.