Summary
网页内容获取技巧集合。当用户需要抓取网页内容、提取文章正文、获取社交媒体帖子内容、读取任意 URL 的文本或 Markdown 格式内容时使用。 无论用户是想"获取某个网页的内容"、"抓取这个链接"、"读取这篇文章"、"把这个页面转成 Markdown"，还是想访问 X/Twitter、微信、知乎、Medium…
nangongwentian-fe/agent-skills · Archived
web-content-fetcher
获取?
Installation
$
npx skills add nangongwentian-fe/agent-skills --skill web-content-fetcher
Stronger alternatives
This repository is archived — consider an actively maintained alternative.
persistent-memory
Same source · more installs
nangongwentian-fe/agent-skills
通用跨会话记忆协议（Universal Memory Protocol）。让所有 AI 编程工具共享同一套记忆系统。适用 Cla…
23 installs
exa-unified-research
Same source · more installs
nangongwentian-fe/agent-skills
Use this skill for ANY web research task — looking up companies, finding people, searching for …
10 installs
code-review-uncommitted
Same source · more installs
nangongwentian-fe/agent-skills
8 installs
git-rebase-workflow
Same source · more installs
nangongwentian-fe/agent-skills
Git Rebase 分支同步流程，用于将当前功能分支 rebase 到最新的目标分支（如 master/main），保持提交…
8 installsSimilar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
find-skills
Same topic
vercel-labs/skills
Helps users discover and install agent skills when they ask questions like "how do I do X", "fi…
3.3M installs
agent-browser
Same topic
vercel-labs/agent-browser
Browser automation CLI for AI agents. Use when the user needs to interact with websites, includ…
810.4K installs
vercel-react-best-practices
Same topic
vercel-labs/agent-skills
697.8K installs
web-design-guidelines
Same topic
vercel-labs/agent-skills
Review UI code for Web Interface Guidelines compliance. Use when asked to "review my UI", "chec…
617.3K installs
microsoft-foundry
Same topic
microsoft/azure-skills
Build, deploy, evaluate, optimize, fine-tune, and manage Microsoft Foundry agents, models, and …
576.5K installs
azure-prepare
Same topic
microsoft/azure-skills
Prepare azd-based Azure projects for deployment: generates azure.yaml, infrastructure (Bicep/Te…
568.3K installsAlso in this package
Other skills from nangongwentian-fe/agent-skills.
npx skills add nangongwentian-fe/agent-skills
More details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Claude Code
Not declared
Cursor
Not declared
Codex
Not declared
GitHub Copilot
Not declared
Windsurf
Not declared
Gemini CLI
Not declared
Cline
Not declared
OpenCode
Not declared
Repository health
Stars
12
Default branch
main
Open issues
0
Status
Archived
Package contents
Files included with this skill beyond the listing page.
-
skill md
SKILL.md2,438 B -
docs
SUMMARY.md456 B
History
- First seen on skills.sh
- First recorded snapshot · 1 installs
SKILL.md
网页内容获取技巧集合
本 skill 的核心思路：渐进回退，确保拿到内容。
回退策略
任何 URL 都按以下顺序尝试，不区分网页类型：
- WebFetch 直接抓取 — 最快，先试
- 如果失败或内容不完整 — 并行尝试
r.jina.ai和defuddle.md两种代理前缀，取内容更完整的结果 - 如果代理也失败 — 使用 WebSearch 搜索相关内容作为兜底
"不完整"的判断：返回正文少于 200 字、明显缺失关键段落、或返回错误/空白页面。
方法一：r.jina.ai 前缀
在目标 URL 前加上 https://r.jina.ai/ 前缀，用 WebFetch 抓取：
https://r.jina.ai/<目标URL>示例
https://r.jina.ai/https://x.com/qoder_ai_ide/status/2036437931867644016
https://r.jina.ai/https://www.anthropic.com/engineering/some-post
https://r.jina.ai/https://any-website.com/any-page特点
- 会自动执行 JS 渲染，对动态页面和 SPA 支持好
- 返回经过清洗的 Markdown 格式正文
- 响应稍慢但内容覆盖面广
方法二：defuddle.md 前缀
在目标 URL 前加上 https://defuddle.md/ 前缀，用 WebFetch 抓取：
https://defuddle.md/<目标URL>示例
https://defuddle.md/https://mp.weixin.qq.com/s/ERSjcq9YURHvlsdTUv_Paw
https://defuddle.md/https://example.com/some-article
https://defuddle.md/https://any-website.com/any-page特点
- 自动去除广告、导航栏等干扰元素，只保留正文
- 返回 Markdown 格式
- 响应较快
通用注意事项
- 两种代理方式都仅支持公开可访问的页面，需要登录的内容无法获取
- 图片等媒体资源不会返回，仅返回文字内容
- 两种方式各有擅长，无法预知哪个对特定网站效果更好，所以失败时应并行尝试两者
本 skill 持续更新中。如需添加新的获取方法，按照相同格式补充即可。