Chapter Evaluator

What it does

The Chapter Evaluator skill analyzes educational chapters to assess their quality from both a student and teacher perspective. It evaluates aspects like engagement, clarity, length, and effectiveness of hands-on exercises. The tool provides structured feedback with ratings, identifies gaps in content, and suggests actionable improvements to streamline writing workflows.

When to use it

• Analyzing a chapter's overall quality before publication.
• Identifying why content feels ineffective (e.g., too short, boring, disconnected).
• Planning improvements for existing chapters.
• Comparing chapters against established quality standards.
• When you need an assessment of educational material and want to understand how it will be received by learners.

Key capabilities

• Dual Perspective Analysis: Evaluates content from both a student's (engagement, clarity) and teacher’s (pedagogy, objectives) viewpoint.
• Engagement Scoring (1-10): Assesses the compelling nature of the chapter based on factors like hooks, real-world relevance, and narrative flow.
• Length Assessment: Determines if a chapter is too short, just right, or too long, with word count benchmarks provided for different lesson types.
• Clarity Scoring (1-10): Evaluates the understandability of the content based on factors like jargon usage, logical flow, and transitions.
• Hands-On Effectiveness Scoring (1-10): Measures how well hands-on exercises contribute to learning.
• Content Extraction: Automatically gathers chapter content including YAML frontmatter, word count, section structure, code examples, and hands-on exercises from a specified directory.

Example prompts

• "Evaluate this chapter for student engagement."
• "Review this chapter and assess its clarity."
• "Analyze this chapter and provide feedback on the effectiveness of the hands-on exercises."

Tips & gotchas

• The skill requires access to a "chapter directory" containing lesson files. You'll need to specify the correct path for it to function correctly.
• Evaluation is based on predefined criteria; results are subjective assessments, not definitive judgments.
• The skill extracts content using ls and grep, so ensure these commands are available in the environment where the agent is running.