Scraping
Extracts structured data from websites based on user-defined rules, automating information gathering tasks.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add scraping npx -- -y @trustedskills/scraping
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"scraping": {
"command": "npx",
"args": [
"-y",
"@trustedskills/scraping"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
This skill enables AI agents to extract data from websites by navigating pages and retrieving specific text or structured information. It allows agents to bypass standard search limitations to access raw content directly from web sources.
When to use it
- Gathering real-time market prices, stock data, or weather forecasts that require direct source verification.
- Extracting specific fields like job titles, contact emails, or product specifications from directories.
- Aggregating news headlines or blog posts to summarize current events for a report.
- Retrieving unstructured text from legacy sites that lack modern APIs.
Key capabilities
- Navigates web pages to locate target content.
- Extracts specific text snippets based on user instructions.
- Handles dynamic content loading where applicable.
- Returns raw data suitable for further processing or analysis.
Example prompts
- "Scrape the top 5 headlines from the technology news section of TechCrunch.com."
- "Extract all job titles and company names listed on this career portal page."
- "Get the current price of the latest iPhone model from the Apple store website."
Tips & gotchas
- Ensure the target website does not have aggressive anti-bot protections that might block automated requests.
- Verify that scraping the specific site complies with its Terms of Service and local laws before deployment.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.