搜索

PythonReactSEOPDF
GitHub Skill

web-scraper

Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.

CoWork-OS☆ 139 仓库 Stars14 仓库 Forks

安装与使用

请根据来源仓库和你的 AI 工具说明安装此技能。先阅读技能文件和依赖要求,再添加到工作流。

查看来源 ↗使用指南

技能说明

Web Scraper

Purpose

Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.

Routing

  • Use when: Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
  • Do not use when: Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
  • Outputs: Extracted web content including text, tables, links, images, and metadata.
  • Success criteria: Successfully extracts the requested content from the target URL with clean formatting.

Trigger Examples

Positive
  • Use the web-scraper skill for this request.
  • Help me with web scraper.
  • Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
  • Web Scraper: provide an actionable result.
Negative
  • Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
  • Do not use web-scraper for unrelated requests.
  • This request is outside web scraper scope.
  • This is conceptual discussion only; no tool workflow is needed.

Parameters

Name Type Required Description
url string Yes URL to scrape
selector string No CSS selector for specific content (optional)

Runtime Prompt

  • Current runtime prompt length: 1117 characters.
  • Runtime prompt is defined directly in ../web-scraper.json.

使用示例

查看来源仓库中的使用示例与配置说明。

查看来源 ↗

来源历史

收录时间
2026-03-11
索引更新时间
2026-03-11
Branch
main

收录与同步日期属于本站记录。源码修改历史请查看来源仓库。

GitHub ↗

chat Comments (0)

chat_bubble_outline

No comments yet. Be the first to share your thoughts!