Candidate Evaluation

What it does

This skill analyzes GitHub contributors or candidates for engineering roles, specifically within Pollinations. It gathers data from a candidate's GitHub profile using the GitHub API and Model Context Protocol (MCP) to assess their skills and work style. The analysis results in a formatted report including a fit score, strengths, weaknesses, key repositories, and a hiring recommendation presented with ASCII art and a skills matrix.

When to use it

• When you need to evaluate a potential contributor or candidate for an engineering role.
• To research GitHub profiles as part of the hiring process.
• To update the CONTRIBUTORS.md file with analysis of candidates.
• When discussing "hiring," "candidate," "MLOps," or "evaluate contributor."

Key capabilities

• GitHub API Integration: Retrieves repository and pull request information using the GitHub API.
• Model Context Protocol (MCP) Support: Utilizes MCP to access candidate data.
• Skill Assessment: Evaluates proficiency in Python, DevOps tools (Docker, CI/CD), GPU/ML deployment technologies, Kubernetes, vLLM, TGI, Quantization and CI/CD pipelines.
• Work Style Analysis: Assesses PR size preference, response time to reviews, documentation quality, and test coverage habits.
• Formatted Reporting: Generates a structured report with a fit score (1-10), strengths, weaknesses, key repositories, and hiring recommendation using ASCII art and a skills matrix.

Example prompts

• "Evaluate @username for MLOps role"
• "Research GitHub profile for {username}"
• "Add {username} to CONTRIBUTORS.md"

Tips & gotchas

• The skill relies on the candidate having an active GitHub presence and public repositories.
• Results are based solely on publicly available information from GitHub; they do not account for other factors in a hiring decision.
• To get the most accurate results, ensure the username provided is correct and corresponds to the intended candidate's GitHub profile.