scraper-builder

What it does

This skill enables AI agents to construct custom web scrapers directly from natural language instructions. It automates the process of building tools to extract specific data from websites without requiring manual coding or configuration.

When to use it

• You need to gather structured data (like prices, articles, or contact info) from a public website quickly.
• Your agent requires a reusable tool to monitor changes on a site over time.
• You want to bypass the need for manual browser automation setup for one-off data extraction tasks.

Key capabilities

• Generates functional web scraper code based on user prompts.
• Configures scraping logic to target specific elements or patterns on a page.
• Outputs ready-to-use scripts that can be executed by the agent's environment.

Example prompts

• "Build a scraper to extract all product titles and prices from this e-commerce homepage."
• "Create a tool that scrapes recent blog posts and their publication dates from a news site."
• "Write a script to collect email addresses listed in the contact section of multiple company websites."

Tips & gotchas

Ensure the target website allows automated scraping by checking its robots.txt file and terms of service to avoid legal issues. Be mindful of rate limits; if the scraper fails repeatedly, add delays between requests to prevent being blocked.