Now liveThe Skillselion MCP - thousands of ranked skills, loaded into your agent mid-task. No install.Get it →

d4vinci/scrapling

1 skill · 2.9k installs · 72.6k stars · GitHub

Install

npx skills add https://github.com/d4vinci/scrapling

Skills in this repo

1Scrapling OfficialScrapling Official is the author-maintained skill for the Scrapling adaptive web scraping framework supporting single requests through full concurrent crawls with pause, resume, and proxy rotation. The parser learns from site changes to relocate elements, while fetchers bypass Cloudflare Turnstile and stealth headless browsing handles dynamic pages. Setup installs scrapling with all extras in a virtualenv, runs scrapling install --force for browser dependencies, and optionally uses Docker images when Python is unavailable. CLI extract commands include get, post, fetch, and stealthy-fetch with output formats chosen by file extension for HTML, Markdown, or clean text, plus --css-selector for partial extraction. Command selection escalates from get for simple sites to fetch for dynamic apps to stealthy-fetch for protected anti-bot pages. Critical safety requires --ai-targeted on CLI commands to reduce prompt injection risk and enable ad blocking in browser modes. Python API and spiders framework support concurrent multi-session crawls when code-based scraping is required.2.9kinstalls

Five minutes, every Monday - the tools, releases and tactics for developers.

unsubscribe anytime.

d4vinci/scrapling · 1 skills · Skillselion