High-performance sequence packing library for LLM training with Rust core and Python bindings
High-performance sequence packing for LLM training