streams for a data pipeline
create a pipeline of streams using Minipass
Pipeline stream for software architecture of Domain-Driven Design and Data-Oriented Design.
Chain functions, generators, Node streams, and Web streams into a pipeline with backpressure support.
minimal implementation of a PassThrough stream
Modern stream composer
Simple in-memory vinyl file store
An iteration of the Node.js core streams with a series of improvements
[](https://npmjs.org/package/stream-combiner) [](https://travis-ci.org/dominictarr/stream-combiner)
A pipeline stream server for sending data via json and websockets
streaming pipeline with a mutable configuration
Combine an array of streams into a single duplex stream using pump and duplexify
This is a sequel to [stream-combiner](https://npmjs.org/package/stream-combiner) for streams3.
Streaming utilities for AI assistants
Node.js Streams, a user-land copy of the stream library from Node.js
A mature CSV toolset with simple api, full of options and tested against large datasets.
Check if something is a Node.js stream
merge multiple sorted streams into a single sorted stream
Get a stream as a string, Buffer, ArrayBuffer or array
Creates a parallel transform from async function
tar-stream is a streaming tar parser and generator and nothing else. It operates purely using streams which means you can easily extract/parse tarballs without ever hitting the file system.
destroy a stream if possible
TypeScript definitions for gulp-plumber
Toggle the CLI cursor
Pipelines for streaming large collections with composition inspired by Elixir pipes.
ActiveVlc provides a convenient DSL to build VLC transcoding and/or streaming pipelines
This gem makes it possible to build filters or pipelines for processing data into or out of streams of bytes while maintaining compatibility with native Ruby IO classes. Ruby IO classes may function as both sources and sinks, or entirely new IO implementations may be created.
SmarterCSV is a high-performance CSV reader and writer for Ruby focused on fastest end-to-end ingestion — not just parsing. It returns ready-to-use hashes with configurable header and value transformations, intelligent defaults, and automatic delimiter discovery. Built for real-world data pipelines, SmarterCSV supports chunked processing for large files, streaming via Enumerable APIs, and C acceleration to optimize the full ingestion path (parsing + hash construction + conversions). Designed to handle messy user-uploaded CSV while remaining easy to integrate with Rails, ActiveRecord imports, Sidekiq jobs, parallel processing, and S3-based workflows.
This gem is a Logstash plugin that augments stream with WURFL device detection data and is required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/logstash-plugin install gemname. This gem is not a stand-alone program. Please note that this plugin requires a running instance of WURFL Microservice (https://www.scientiamobile.com/products/wurfl-microservice)
EXPERIMENTAL. A form of data-flow programming based loosely on Kahn Process Networks. Will allow for setting up operational components that can be pipelined together in a graph. Assumes all components (nodes) are 'online' algorithms with more or less steady-state resource utilization for continuous streams of data.
ConduitSSE provides a flexible callback-based architecture for processing real-time server push data with full control over every stage of the parsing pipeline. Perfect for streaming AI responses, real-time analytics, and live updates.
Ciphr is a CLI tool for performing and composing encoding, decoding, encryption, decryption, hashing, and other various operations on streams of data. It takes provided data, file data, or data from stdin, and executes a pipeline of functions on the data stream, writing the resulting data to stdout. It was designed primarily for use in the information security domain, mostly for quick or casual data manipulation for forensics, penetration testing, or capture-the-flag events; it likely could have other unforseen uses, but should be presumed to be an experimental toy as no effort was made to make included cryptographic functions robust against attacks (timing attacks, etc), and it is recommended not to use any included functions in any on-line security mechanisms.
SolidStackWeb is a mountable Rails engine that provides a production-ready operations dashboard for the full Solid Stack. It covers Solid Queue (job browser, failed job retry with inline argument editing, queue pause/resume, recurring tasks, performance stats, CSV export, and alert webhooks), Solid Cache (entry browser, size distribution, 24-hour write timeline, and optional value preview), and Solid Cable (channel browser, per-channel message list, and purge controls). Ships with dark mode, Turbo Stream responses, a JSON metrics endpoint, and no asset pipeline dependency.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.