modelscope.cn

firecrawl

专业网页抓取和数据提取。使用 Firecrawl API 抓取网页、提取结构化数据、批量爬取网站。当用户需要抓取复杂网页、提取结构化数据、批量爬取时使用此技能。

Installation

$ npx skills add https://modelscope.cn

Similar popular skills

Related neighbors and high-traction skills in the same topics — useful to compare before installing.

Also in this package

Other skills from modelscope.cn · top by installs.

npx skills add https://modelscope.cn

Browse all from modelscope.cn

More details

Agent compatibility

Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.

Claude Code Not declared
Cursor Not declared
Codex Not declared
GitHub Copilot Not declared
Windsurf Not declared
Gemini CLI Not declared
Cline Not declared
OpenCode Not declared

Skill metadata

Parsed from SKILL.md frontmatter.

Allowed toolsBash, Read, Write, Edit

Package contents

Files included with this skill beyond the listing page.

  • skill md SKILL.md 1,461 B

History

  1. First recorded snapshot · 0 installs

SKILL.md

Firecrawl 网页抓取

功能说明

此技能使用 Firecrawl API 提供专业网页抓取能力:

  • 单页抓取(支持动态内容)
  • 结构化数据提取
  • 批量网站爬取
  • 搜索并抓取

使用方式

1. 抓取单个网页

./scripts/firecrawl.sh scrape <url> [format]
  • format: markdown (默认), html, text, json

2. 提取结构化数据

./scripts/firecrawl.sh extract <url> <schema>

3. 批量爬取网站

./scripts/firecrawl.sh crawl <url> [max_pages]

4. 搜索并抓取

./scripts/firecrawl.sh search <query> [limit]

API Key

存储在: pass show api/firecrawl

示例

抓取 Polymarket 页面

./scripts/firecrawl.sh scrape "https://polymarket.com/event/fed-decision-in-march-885"

提取产品信息

./scripts/firecrawl.sh extract "https://example.com/product" '{"name": "string", "price": "number"}'

搜索 AI 新闻

./scripts/firecrawl.sh search "latest AI news" 5

注意事项

  • Firecrawl 有使用限制(取决于套餐)
  • 复杂网页可能需要更长的处理时间
  • 某些网站可能有反爬虫机制