Web Article Extractor
ListedExtracts key information, summaries, and relevant data from web articles based on user prompts.
Install on your platform
Showing Claude Code. One command installs this skill into any of the agents below.
- 1
Run this in your project
terminal$ npx skills add dongbeixiaohuo/writing-agent --skill web-article-extractor -a claude-code Uses the open-source
skillsCLI and needs Node.js. Add-gto install it for your user instead of this project.
What we know about this skill
Publisher
dongbeixiaohuo
Taken from the source listing. We haven't verified who controls this account.
Install target
Live repository
Not pinned. Installing fetches whatever the repository holds at the time you run the command.
Automated safety checks
This skill failed 1 of 6 checks. A failure is not proof of bad intent; it means something in the code needs a human to look at it before you run it.
No undeclared network calls: failed
Contacts 2 hosts that are neither well-known infrastructure nor declared in the skill's frontmatter: code.google.com, mobile.slate.com.
Every host the skill dials — from its scripts, its config endpoints or the commands it tells the agent to run — is either well-known package and API infrastructure or declared in its own frontmatter. Links in documentation are not counted.
Hosts contacted
www.apache.orgstandardscode.google.comundeclaredmobile.slate.comundeclaredWhat it found (3 of 6)
- .claude/skills/web-article-extractor/scripts/Readability.js:19contacts code.google.com
* available at: http://code.google.com/p/arc90labs-readability - claude-runtime/skills/web-article-extractor/scripts/Readability.js:19contacts code.google.com
* available at: http://code.google.com/p/arc90labs-readability - plugins/writing-agent/skills/web-article-extractor/scripts/Readability.js:19contacts code.google.com
* available at: http://code.google.com/p/arc90labs-readability
Declares what it does: passed
SKILL.md parses and declares a name and a description.
SKILL.md exists, its frontmatter parses, and it declares a name and a description.
No obfuscated payloads: passed
No encoded or obfuscated payloads.
No base64, hex or compressed blob is decoded and then executed, and no encoded shell commands.
No credential access: passed
Reads no keys, tokens, keychains or credential files.
Neither the code nor the SKILL.md instructions read SSH keys, cloud credentials, keychains, token stores, browser cookie databases or dotfiles that hold secrets.
No pipe-to-shell installers: passed
No pipe-to-shell or download-and-run installers.
No `curl … | sh` pattern, in the code or in the instructions, that runs code fetched at run time.
Pinned to a commit: passed
Scanned dongbeixiaohuo/writing-agent at ca01dcf989.
The exact upstream commit SHA that was scanned is recorded, so the result refers to specific bytes.
- Commit
- ca01dcf989
- Scanned
- 51 files, 12,885 lines
- Copies in repo
- 3 — all of them scanned
About this skill
The web-article-extractor skill retrieves and processes full text from specified URLs, converting raw HTML into clean, readable article content for AI agents. It is designed to strip away navigation menus, ads, and boilerplate code to deliver only the core narrative or data within a webpage.
When to use it
- Research synthesis: Quickly gather context from multiple news articles or research papers before summarizing them.
- Data extraction: Pull specific text blocks from documentation sites or blogs to feed into analysis workflows.
- Content auditing: Retrieve full versions of web pages to verify accuracy against cached or summarized versions.
- Cross-referencing: Fetch related articles from different domains to build a comprehensive knowledge base for complex queries.
Key capabilities
- Fetches content directly from provided URLs.
- Parses HTML to remove non-essential elements like headers, footers, and scripts.
- Returns clean text suitable for further processing by AI agents.
Example prompts
- "Extract the main article text from https://example.com/blog/latest-updates and summarize the key points."
- "Use web-article-extractor to get the full content of this documentation page so I can answer a user's technical question accurately."
- "Retrieve the text from these three URLs about market trends and compare their perspectives on inflation."
Tips & gotchas
Ensure the target URL is publicly accessible and not behind a login wall, as the tool cannot bypass authentication. For best results, provide direct links to specific article pages rather than homepage URLs to minimize irrelevant content extraction.