Crawl data from webpages and apply content extraction.
General purpose crawler for web pages
Request client
n8n node to crawl WordPress REST API endpoints dynamically
A lightweight and modular web crawling framework built with Puppeteer.
Proxy loader/parser
A awesome project
A simple, lightweight AI web scraping tool.
A simple, lightweight AI web scraping tool.
A awesome project
MCP server for the Crawly web scraping & YouTube transcript API. 2 tools, future-proof — auto-discovers new endpoints.
lib to encapsulate browser data
make output crawl across your terminal all spooky like
A awesome project
http proxy middleware for express