Scrape web pages, storing pages locally to lessen repetitive network requests.
A cache object that deletes the least-recently-used items.
A caching server for easily writing transformations against remote resources: munge, reformat, scrape, cache and rebroadcast stuff.
A lightweight cache for file metadata, ideal for processes that work on a specific set of files and only need to reprocess files that have changed since the last run
Require hook for automatic V8 compile cache persistence
A simple key/value storage using files to persist the data
Scrape documentation frameworks to Mintlify docs
Require hook for automatic V8 compile cache persistence
Parses Cache-Control and other headers. Helps building correct HTTP caches and proxies
TypeScript definitions for http-cache-semantics
Basic object cache with `get`, `set`, `del`, and `has` methods for node.js/javascript projects.
LRU and FIFO caches for Client or Server
JavaScript SDK for Firecrawl API
A generational pseudo-LRU cache with strict maximum size limits.
[](https://www.npmjs.com/package/@aws-sdk/endpoint-cache) [](https://www.npmjs.com/package/@aws-sdk/e
An LRU cache of weak references
A super-fast, promise-based cache that reads and writes to the file-system.
Create a full Content-Type header given a MIME type or extension and cache the result
No description provided.
Simple and fast NodeJS internal caching. Node internal in memory cache like memcached.
Search from DuckDuckGo and use it's spice APIs.
The time-based use-recency-unaware cousin of [`lru-cache`](http://npm.im/lru-cache)
node-simple-lru-cache =====================
High Performance In-Memory Cache for Node.js
A careless caching client optimized for scraping.
A Rails Engine using ActiveRecord to cache results of HTTP scrapes
Ruby API layer that transparently queries, scrapes and caches Metal Archives' website
Scrapetor is a Ruby HTML parsing + scraping toolkit. The parser is a native C arena DOM with structural indexes built at parse time and NEON SIMD scanners in the SAX hot loop. A streaming extraction engine compiles the schema DSL into a single forward pass — no DOM materialised, one Ruby boundary crossing per document. On builds where libcurl is available, Scrapetor::Fetcher adds an HTTP/2-capable fetch layer with per-thread connection cache, shared DNS + TLS session pool, in-process gzip / deflate / brotli / zstd decoding, iconv charset transcoding, retry + exponential backoff, ETag / Last-Modified disk cache with bulk revalidation, per-host throttle, cookie jar, basic + bearer auth, proxy, and three bulk concurrency models (parallel_fetch / multi_fetch / streaming multi_each). Scrapetor::Session ties the cookie / auth / throttle / retry policies together. Also ships robots.txt + sitemap.xml parsers, a bounded-memory streaming HTML parser, and structured-data extractors (JSON-LD, OpenGraph, Schema.org, Microdata, RDFa, Twitter Cards). The Net::HTTP-based Scrapetor.fetch is preserved as the no-libcurl fallback.