Authenticated Web Scraper
Securely extracts data from websites requiring login credentials, bypassing access restrictions for authorized investigations.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add authenticated-web-scraper npx -- -y @trustedskills/authenticated-web-scraper
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"authenticated-web-scraper": {
"command": "npx",
"args": [
"-y",
"@trustedskills/authenticated-web-scraper"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
This skill enables AI agents to access and extract data from websites that require user authentication, such as logged-in dashboards or private forums. It bypasses standard public scraping limitations by handling login sessions securely on behalf of the agent.
When to use it
- You need to gather data from internal company portals where public access is restricted.
- Your agent must retrieve personal profile details or transaction history behind a login wall.
- You require access to member-only communities or subscription-based content sites.
- Standard
fetchorcurlrequests fail due to missing session cookies or tokens.
Key capabilities
- Manages authentication sessions for protected web resources.
- Extracts data from pages inaccessible without valid credentials.
- Maintains context of logged-in states during scraping operations.
- Operates within the security category to handle sensitive access patterns.
Example prompts
- "Scrape my recent order history from the customer portal at example.com."
- "Extract the list of active projects from our internal Jira dashboard."
- "Gather user comments from the private beta forum thread ID 12345."
Tips & gotchas
Ensure you have valid credentials ready, as this skill requires a login to function. Be mindful of rate limits on authenticated endpoints to avoid triggering account lockouts or security flags.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.