Crawl
tavily-ai
Simulates web crawling to extract data from websites based on provided URLs and extraction rules.
Claude Code
vlatest1.8k
Browse skills
41,264 listings from across the agent ecosystem. None of them have been code-reviewed — check the source before you install.
Looking for what's new? See the repos gaining stars fastest.
3 skills matching “crawl”
Checked
Checked
Llms Txt Crawler
agykit
This skill uses LLMs to crawl and extract specific text content from websites, saving you time on data gathering.
Claude Code
vlatest9
SEO GEO
AgriciDaniel
Optimize content for AI Overviews (formerly SGE), ChatGPT web search, Perplexity, and other AI-powered search experiences. Generative Engine Optimization (GEO) analysis including brand mention signals, AI crawler accessibility, llms.txt compliance, passage-level citability scoring, and platform-specific optimization.
OpenClawClaude
v1.0.0
Can't find what you need?