Now liveThe Skillselion MCP - thousands of ranked skills, loaded into your agent mid-task. No install.Get it →

yfe404/web-scraper

1 skill · 343 installs · 80 stars · GitHub

Install

npx skills add https://github.com/yfe404/web-scraper

Skills in this repo

1Web Scrapingweb-scraping is a MIT-licensed agent skill in yfe404/web-scraper for intelligent scrape planning and implementation. It runs Phases 0–5: curl-first assessment, conditional browser recon with proxy-MCP traffic capture, deep scans for missing fields, validation of selectors and JSON paths, optional protection testing, and a self-critique report per `reference/report-schema.md`. It detects Next.js, Nuxt, WordPress, and Shopify signatures, escalates through stealth browsers and upstream proxies, then implements Cheerio, API, sitemap, or hybrid Crawlee patterns. Productionization uses `apify create` and `apify push` for TypeScript Actors. The reference documents 80+ proxy-MCP tools. Reach for web-scraping when blocked on strategy choice or need a validated intelligence report before coding. Skip it for one-line curl tasks or sites where official APIs already cover the data.343installs

Five minutes, every Monday - the tools, releases and tactics for developers.

unsubscribe anytime.

yfe404/web-scraper · 1 skills · Skillselion