Data Validation Reporter

What it does

The data-validation-reporter skill generates reports on the validity of datasets. It assesses data quality based on defined rules and provides a structured output summarizing findings, including error counts and potential issues. This allows users to quickly understand the health of their data without manual inspection.

When to use it

• Data pipeline monitoring: Regularly check incoming data for errors or inconsistencies after ingestion into a system.
• Pre-training dataset assessment: Evaluate the quality of datasets before using them to train machine learning models.
• Data migration validation: Verify that data has been accurately transferred during a database migration process.
• Report generation: Produce standardized reports on data validity for stakeholders or compliance purposes.

Key capabilities

• Rule-based data validation
• Structured report generation
• Error counting and identification
• Dataset health assessment

Example prompts

• "Generate a data validation report for the 'customer_data.csv' file using these rules: [list of rules]"
• "Assess the validity of the dataset at this URL: [URL] and provide a summary."
• "Run the data validation reporter on the 'product_catalog' table, checking for missing values in required fields."

Tips & gotchas

The skill requires a clear definition of data validation rules to be effective. Ensure these rules are provided in a format the agent can understand (e.g., JSON schema or similar).