Generate scraping code: 1. Use requests-html or Scrapy 2. Implement rate limiting 3. Generate parsing logic 4. Add retry mechanisms 5. Create data extraction 6. Implement proxies 7. Add error handling 8. Generate documentation
Cursor rules for building high-performance APIs with FastAPI, including async patterns and Pydantic.
Cursor rules for Node.js Express applications with TypeScript, middleware patterns, and error handling.
Cursor rules for building robust API routes in Next.js with validation, error handling, and authentication.
Gemini
backend
AI coding rules customize how Gemini generates and refactors code for your project. Follow these steps to install Gemini Web Scraping Patterns.
.cursor/rules, for Windsurf use .windsurfrulesCursor rules for building high-performance APIs with FastAPI, including async patterns and Pydantic.
Cursor rules for Node.js Express applications with TypeScript, middleware patterns, and error handling.
Cursor rules for building robust API routes in Next.js with validation, error handling, and authentication.