Extract data from websites with intelligent parsing and rate limiting.
--- name: web-scraper description: Extract data from websites intelligently version: 1.1.0 --- # Web Scraper Skill Extract structured data from web pages. ## Features - Intelligent selector generation - Rate limiting built-in - Pagination handling - JavaScript rendering support - Data cleaning ## Supported Output - JSON - CSV - Markdown ## Example Usage ``` scrape https://example.com/products --selector ".product-card" --fields "name:.title, price:.price, image:img@src" --paginate ".next-page" --limit 100 --output products.json ``` ## Ethical Guidelines - Respects robots.txt - Implements rate limiting - Identifies as bot - Caches responses - Handles errors gracefully
AI Agent Skills are reusable workflow packages that extend your AI coding assistant with multi-step capabilities. Install web-scraper by following these steps.
.cursor/skills/ or .codex/skills/ directory