entelix-tokenizer-hf
v0.6.1crates.io· Rustentelix vendor-accurate TokenCounter wrapping HuggingFace `tokenizers` — Llama / Qwen / Mistral / DeepSeek and any tokenizer.json source
The verdict
Maintained. Niche but maintained, actively maintained.
Live from the crates.io registry · derived rules, not AI
How it scores
MaintenanceHealthy
PopularityNiche
SecurityClean
LicensePermissive
DepsZero deps
Maintenance
Last published this month.
Popularity
5 downloads / week
Security
No known advisories for this version (OSV).
License
MIT
Dependencies
No runtime dependencies
Recent releases
- 0.6.1this month
- 0.6.0this month
- 0.5.5this month
- 0.5.4this month