Low latency batching tool. Bundle lots of single concurrent operations into sequential batches of work.
Transparently batch concurrent requests into efficient bulk operations
Small crate to batch inferences of ONNX models using ort (onnxruntime)
Common utilities for Marque, the marking compiler.
Event-to-channel notification router for Discord — bypass gateway sessions, just events in, messages out
A tiny ML framework
Record async streams with timing, replay deterministically
Optimized batching and dataloading for external services.
Throttled Bitcoin RPC API client for Rust.
Common utilities for Recoco, an all-Rust fork of CocoIndex with greater flexibility.
Collection of sorting algorithms implemented in Rust
A Rust library for splitting large text into smaller batches for LLM input.