Web Scraper
Extracts structured data from websites specified by URL, providing information like prices, product details, and contact info.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add dalehurley-web-scraper npx -- -y @trustedskills/dalehurley-web-scraper
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"dalehurley-web-scraper": {
"command": "npx",
"args": [
"-y",
"@trustedskills/dalehurley-web-scraper"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
The dalehurley-web-scraper skill allows AI agents to extract data from websites. It can retrieve specific information based on provided URLs and instructions, transforming raw HTML into structured data. This is useful for gathering information that isn't easily accessible through direct APIs or search results.
When to use it
- Market Research: Extract product prices and descriptions from competitor websites.
- News Aggregation: Gather headlines and summaries from multiple news sources.
- Data Entry Automation: Populate spreadsheets with data scraped from online forms or tables.
- Real Estate Analysis: Collect property listings, addresses, and pricing information from real estate websites.
Key capabilities
- Retrieves content from specified URLs.
- Extracts data based on provided instructions.
- Transforms HTML into structured data.
Example prompts
- "Scrape the product descriptions from [URL] and list them."
- "Get all the headlines from [news website URL]."
- “Extract the table of prices from this page: [URL].”
Tips & gotchas
The skill requires a valid URL to operate. Be mindful of website terms of service and robots.txt files when scraping data, as excessive or unauthorized scraping can be considered unethical or illegal.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.