Wrapper of change-case to create case converter, validator and etc.
Tag utility module
Case-preserving, ASCII case-insensitive, no_std string types.
Distribute and run transformer encoders with a single file.
Model implementations for TrustformeRS
Embedded storage at the speed of light.
A configuration management library for Rust, inspired by esbuild.
Procedural macros for ortho_config.
Blazingly fast tokenizer - 50x faster tokenization, 10x smaller model files, 100% accurate drop-in replacement for HuggingFace
The most complete tokenizer library in Rust - BPE, WordPiece, Unigram, with native support for GPT, BERT, Llama, Claude
ε-serde is an ε-copy (i.e., almost zero-copy) serialization/deserialization framework
Procedural macros for ε-serde
HuggingFace integration for flodl: safetensors, hub, tokenizers, pre-built models
Token-aware, multi-format text chunking library with language-aware semantic splitting