Authenticated Web Scraper

🌐Community
by rysweet · vlatest · Repository

Securely extracts data from websites requiring login credentials, bypassing access restrictions for authorized investigations.

Install on your platform

We auto-selected Claude Code based on this skill’s supported platforms.

1

Run in terminal (recommended)

terminal
claude mcp add authenticated-web-scraper npx -- -y @trustedskills/authenticated-web-scraper
2

Or manually add to ~/.claude/settings.json

~/.claude/settings.json
{
  "mcpServers": {
    "authenticated-web-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "@trustedskills/authenticated-web-scraper"
      ]
    }
  }
}

Requires Claude Code (claude CLI). Run claude --version to verify your install.

About This Skill

What it does

This skill enables AI agents to access and extract data from websites that require user authentication, such as logged-in dashboards or private forums. It bypasses standard public scraping limitations by handling login sessions securely on behalf of the agent.

When to use it

  • You need to gather data from internal company portals where public access is restricted.
  • Your agent must retrieve personal profile details or transaction history behind a login wall.
  • You require access to member-only communities or subscription-based content sites.
  • Standard fetch or curl requests fail due to missing session cookies or tokens.

Key capabilities

  • Manages authentication sessions for protected web resources.
  • Extracts data from pages inaccessible without valid credentials.
  • Maintains context of logged-in states during scraping operations.
  • Operates within the security category to handle sensitive access patterns.

Example prompts

  • "Scrape my recent order history from the customer portal at example.com."
  • "Extract the list of active projects from our internal Jira dashboard."
  • "Gather user comments from the private beta forum thread ID 12345."

Tips & gotchas

Ensure you have valid credentials ready, as this skill requires a login to function. Be mindful of rate limits on authenticated endpoints to avoid triggering account lockouts or security flags.

Tags

🛡️

TrustedSkills Verification

Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.

Security Audits

Gen Agent Trust HubPass
SocketPass
SnykPass

Details

Version
vlatest
License
Author
rysweet
Installs
35

🌐 Community

Passed automated security scans.