High performance tokenizers for Rust
A powerful Rust authentication and authorization framework
Turns instances of Rust structures into a token stream that creates the instance
Minimal native signed tokens for standalone binaries
Core library for sa-token-rust, a powerful authentication and authorization framework
Tiny Rust zero-dep tokenizer (ident, number, string, parens, operators, keywords).
Hessra biscuit token SDK for Rust
Turns instances of Rust structures into a token stream that creates the instance
Tokenizers for TrustformeRS
Rust API bindings - samberdata_api
Pure Rust tokenizer for GGUF models with llama.cpp compatibility (SentencePiece + BPE + WPM + UGM + RWKV)
Lexical analyzer for Asmodeus language
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.
No description provided.