Simple framework for crawling/scraping web sites. The result is a tree, where each node is a single request.
Async and sync crawler for json object
Agnostic tree traversal library.
Tree-sitter bindings for the web
TypeScript definitions for web-bluetooth
Shared types for the crawlee projects
OpenTelemetry Collector Logs Exporter allows user to send collected logs to the OpenTelemetry Collector
TypeScript definitions for web-push
Official Firecrawl nodes for n8n - scrape, crawl, map, search, and extract data from websites. Supports AI Agent tool usage.
A community node for n8n to integrate Tavily API for web search and content extraction.
Web dev server core
JWA, JWS, JWE, JWT, JWK, JWKS for Node.js, Browser, Cloudflare Workers, Deno, Bun, and other Web-interoperable runtimes
A set of shared utilities that can be used by crawlers
CLI tool for Genspark Tool API - search, crawl, analyze images, generate media
JavaScript SDK for Firecrawl API
A specification compliant robots.txt parser with wildcard (*) matching support.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
A simple in-memory storage implementation of the Apify API
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Rotate multiple browsers using popular automation libraries such as Playwright or Puppeteer.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.