Web Scraper
Extracts structured data from websites based on provided URLs and instructions, delivering clean information quickly.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add web-scraper npx -- -y @trustedskills/web-scraper
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"web-scraper": {
"command": "npx",
"args": [
"-y",
"@trustedskills/web-scraper"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
The web-scraper skill enables AI agents to extract structured data from websites by visiting specified URLs and parsing their HTML content. It allows agents to gather information dynamically without requiring manual browsing or pre-existing datasets.
When to use it
- Extracting product prices, specifications, or availability from e-commerce sites for market analysis.
- Aggregating news headlines or article summaries from multiple sources into a single report.
- Collecting real-time data such as weather updates, stock tickers, or sports scores for decision-making.
- Gathering contact details or business information from directories to build lead lists.
Key capabilities
- Visits user-provided URLs to fetch current webpage content.
- Parses HTML structure to isolate specific text elements or tables.
- Returns extracted data in a format ready for further processing by the agent.
Example prompts
- "Scrape the top 5 headlines from [news-site-url] and summarize them."
- "Extract the current price and stock status of the iPhone 15 from the Apple store page."
- "Gather all email addresses found on the 'Contact Us' page of [company-website]."
Tips & gotchas
Ensure the target website allows automated access; some sites block scrapers via robots.txt or IP restrictions. Always specify clear parameters in your prompt to guide the agent on exactly which data points to extract from the raw HTML.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.