To create a valid gzip from many individual streams first use createDeflatePart() which returns a through stream to convert your parts to the deflated part. when this through stream emits the 'end' event you should call its `metadata()` function which wil
Quickly test to see if a readable stream is gzipped based on its magic number
Get the gzipped size of a string or buffer
An iteration of the Node.js core streams with a series of improvements
A small fast zlib stream built on [minipass](http://npm.im/minipass) and Node.js's zlib binding.
Easily unzip an HTTP stream
Node.js Streams, a user-land copy of the stream library from Node.js
zlib port to javascript - fast, modularized, with browser support
A tiny but capable push & pull stream library for TypeScript and Flow
Check if something is a Node.js stream
A set of efficient utilities that extend the use of JSON (streaming, estimate size, NDJSON/JSONL, etc.)
Get a stream as a string, Buffer, ArrayBuffer or array
tar-stream is a streaming tar parser and generator and nothing else. It operates purely using streams which means you can easily extract/parse tarballs without ever hitting the file system.
Call a callback when a readable/writable/duplex stream has completed or failed.
zlib, gzip and zip implementation in JavaScript
file streams that roll over when size limits, or dates are reached
Toggle the CLI cursor
destroy a stream if possible
A tiny (741b) utility for Server Sent Event (SSE) streaming via `fetch` and Web Streams API
Pure javascript implementation of Zlib nodejs core module. The zlib module provides compression functionality implemented using Gzip, Deflate/Inflate, and Brotli. Compatible with Node.js 22.x LTS.
A tiny, zero-dependency yet spec-compliant asynchronous iterator polyfill/ponyfill for ReadableStreams.
A micro-library of stream components for building custom JSON and JSONC processing pipelines with a minimal memory footprint — parse, filter, and transform JSON far larger than available memory with a SAX-inspired token API, on Node.js or Web Streams.
Get and validate the raw body of a readable stream.
A transport for winston which logs to a rotating file each day.
Simple API for gzip compression and decompression with support for strings, files, and IO streams. Configurable compression level. Built on Ruby stdlib zlib.
Wrapper to read gz/gzip files composed of multiple gz streams (eg, made by doing a cat to join some gz files in a bigger one.)
Ruby HTTP client with streaming support for GZIP compressed streams and chunked transfer encoding. Also includes extensible OAuth support for Adobe and Twitter streaming APIs.
CLI tools for streaming search (s3grep), viewing (s3cat), and reporting (s3info, s3report) on S3 objects. Supports gzip compression and searches large files with minimal memory usage.
A gem to pretty print anything. Currently supports input formats: - ruby (.inspect formatted) - yaml - json And will auto-detect input type, though you can force detection. Outputs yaml by default, but can output ruby, yaml, or json. Input streams or files may be compressed with zlib/deflate, however, gzip is not currently supported.
Scrapetor is a Ruby HTML parsing + scraping toolkit. The parser is a native C arena DOM with structural indexes built at parse time and NEON SIMD scanners in the SAX hot loop. A streaming extraction engine compiles the schema DSL into a single forward pass — no DOM materialised, one Ruby boundary crossing per document. On builds where libcurl is available, Scrapetor::Fetcher adds an HTTP/2-capable fetch layer with per-thread connection cache, shared DNS + TLS session pool, in-process gzip / deflate / brotli / zstd decoding, iconv charset transcoding, retry + exponential backoff, ETag / Last-Modified disk cache with bulk revalidation, per-host throttle, cookie jar, basic + bearer auth, proxy, and three bulk concurrency models (parallel_fetch / multi_fetch / streaming multi_each). Scrapetor::Session ties the cookie / auth / throttle / retry policies together. Also ships robots.txt + sitemap.xml parsers, a bounded-memory streaming HTML parser, and structured-data extractors (JSON-LD, OpenGraph, Schema.org, Microdata, RDFa, Twitter Cards). The Net::HTTP-based Scrapetor.fetch is preserved as the no-libcurl fallback.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.