Results for toktrie

Found in 1 of 7 ecosystems · 4 matches across other registries

How we search: free-text on npm, crates.io, RubyGems, NuGet and Maven. PyPI and Go do exact-name lookup only. Tip: click an ecosystem chip below to filter; click Show all ecosystems to come back.

Sort

Auto-load on scroll

crates.io matches

4 matches · Rust

toktriev1.7.6

crates.io

LLM Token Trie library

Worth a look. Actively maintained and growing, actively maintained.

toktrie_hf_downloaderv1.7.6

crates.io

HuggingFace Hub download library support for toktrie and llguidance

Maintained. Niche but maintained, actively maintained.

toktrie_hf_tokenizersv1.7.6

crates.io

HuggingFace tokenizers library support for toktrie and llguidance

Worth a look. Actively maintained and growing, actively maintained.

toktrie_tiktokenv1.7.6

crates.io

tiktoken (OpenAI BPE) library support for toktrie and llguidance

Maintained. Niche but maintained, actively maintained.