Skip to content
TrustedSkillsbeta
Back to all skills

Ai Safety Auditor

Listed
eddiebe147·vlatest·ai-ml

Analyzes AI outputs for potential harms like bias, toxicity, or misinformation, flagging risks for review.

Repository

Install on your platform

This skill no longer installs under the name ai-safety-auditor. eddiebe147/claude-settings is deleted or private, so it cannot be installed from.

We check each listing against its upstream repository with the rules the skills CLI uses, last on 2026-10-22. We don't show a command we know will fail.

Repository install instructions

What we know about this skill

Publisher

eddiebe147

Taken from the source listing. We haven't verified who controls this account.

Install target

Live repository

Not pinned. Installing fetches whatever the repository holds at the time you run the command.

Nobody has reviewed this code. TrustedSkills indexes and links skills; it does not audit, run or scan them. A skill runs with whatever access you give your agent — read the source before you install it.

Automated safety checks

scanned

We could not read this skill's source, so none of the checks below were run.

Not scanned. repository not found or private Source recorded as eddiebe147/claude-settings.
This is a static scan, not a review. It reads the skill's files; it does not run them, and it cannot tell you whether the skill is any good or whether the code does what its description says. A skill runs with whatever access you give your agent.
What each check looks for →

About this skill

What it does

The AI Safety Auditor skill helps evaluate AI systems for safety, fairness, and responsible deployment. It provides structured workflows to detect potential harms like bias, toxicity, misinformation, privacy violations, or discrimination within AI outputs. The tool focuses on identifying risks before they impact users and assists in building trustworthy and ethically aligned AI systems.

When to use it

This skill is valuable for:

  • Deploying LLM-powered products.
  • Building classifiers with real-world impact.
  • Evaluating third-party AI services.
  • Ensuring compliance with ethical guidelines and risk management practices.
  • Auditing AI systems for bias and harmful outputs.

Key capabilities

  • Bias Audit: Defines protected attributes (demographics, other sensitive factors), measures performance disparities across groups, identifies statistically significant differences, and calculates metrics like demographic parity, equalized odds, and predictive parity.
  • Safety Testing for LLM Systems: Defines safety categories (harmful content, misinformation, privacy violations, etc.), creates test cases including direct requests, obfuscated attacks, and jailbreak attempts, and systematically tests AI models.
  • Harm Assessment: Assesses the severity of harmful outputs generated by an AI model.
  • Documentation: Supports documenting findings and planning mitigation strategies for identified risks.

Example prompts

  • "Conduct a bias audit on this classification model using race and age as protected attributes."
  • "Perform a safety test on this LLM system, focusing on the 'harmful content' category with jailbreak attempts."
  • "Analyze these AI outputs for potential misinformation and hallucination."

Tips & gotchas

  • Requires defining relevant protected attributes and safety categories based on your specific context.
  • The skill relies on test data and cases; ensure they are representative of real-world scenarios to get accurate results.
  • Statistical significance testing and acceptable thresholds need to be defined for bias detection.