Small function you can wrap fs.createReadStream with to get fixed size data chunks
Ledger devices
micromark utility to splice and push with giant arrays
[](https://www.npmjs.com/package/@aws-sdk/chunked-stream-reader-node) [](http
A promise based streaming tokenizer
Modern Buffer API polyfill without footguns
Safer Node.js Buffer API
Node.js Buffer API, for the browser
smart-buffer is a Buffer wrapper that adds automatic read & write offset tracking, string operations, data insertions, and more.
Is this value a JS SharedArrayBuffer?
Get the byte length of an ArrayBuffer, even in engines without a `.byteLength` method.
Get the ArrayBuffer out of a TypedArray, robustly.
Is this value a JS ArrayBuffer?
Get the ArrayBuffer out of a DataView, robustly.
Reads / writes floats / doubles from / to buffers in both modern and ancient browsers.
JSON parse & stringify that supports binary via bops & base64
A [ponyfill](https://ponyfill.com) for `Buffer.from`, uses native implementation if available.
A pure javascript CRC32 algorithm that plays nice with binary data
Pass in a string, array, Buffer, Data View, or Uint8Array, and get a Buffer back.
Determine if an object is a Buffer
Convert a typed array to a Buffer without a copy
Read/write IEEE754 floating point numbers from/to a Buffer or array-like object
Source code handling classes for webpack
minimal implementation of a PassThrough stream
Fluentd memory buffer plugin with many types of chunk limits
Fluentd plugin derive metrics from log buffer chunks and submit to various metrics backends
Fluentd memory buffer plugin with many types of chunk limits
PostgreSQL Cursor is an extension to the ActiveRecord PostgreSQLAdapter for very large result sets. It provides a cursor open/fetch/close interface to access data without loading all rows into memory, and instead loads the result rows in 'chunks' (default of 1_000 rows), buffers them, and returns the rows one at a time.
A powerful tool for RAG (Retrieval-Augmented Generation) that splits text into chunks based on semantic meaning rather than just character counts. Supports sliding windows, adaptive buffering, and dynamic percentile-based thresholding.
enumerator_io allows you to wrap an enumerator in an IO-compatible interface, enabling chunked reads and efficient memory usage. Ideal for streaming large files or processing data in real-time without buffering everything into memory.