gn00678465/crawler-skill · Archived
crawler
Fetches web pages and converts them to clean markdown using a robust 3-tier chain (Firecrawl → Jina Reader → Scrapling stealth browser). Use this skill instead…
Installation
npx skills add https://github.com/gn00678465/crawler-skill
Stronger alternatives
This repository is archived — consider an actively maintained alternative.
Web scraping plus social data: YouTube, TikTok, Instagram, LinkedIn, Reddit, Threads, plus robu…
3.9K installsAI crawler access analysis. Checks robots.txt, meta tags, and HTTP headers to determine which A…
583 installsCrawl and extract content from websites
352 installsSimilar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
小红书作品爬取工?
306 installs抖音作品爬取工?
301 installsUniversal archivist for personal file archives (Dropbox/B2/Gmail-takeout/local-mount/hard-drive…
147 installsAudit AI crawler access and Google AI-feature eligibility for a page — check the snippet contro…
147 installs中国新闻站点内容提取。支持微信公众号、今日头条、网易新闻、搜狐新闻、腾讯新闻。当用户需要提取中…
119 installsMore details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Repository health
main
History
- First seen on skills.sh
- First recorded snapshot · 130 installs