entelix-tokenizer-tiktoken

v0.6.1crates.io· Rust

entelix vendor-accurate TokenCounter for OpenAI BPE encodings (cl100k_base, o200k_base, p50k_base, r50k_base) — wraps tiktoken-rs with eager preload

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the crates.io registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published this month.

Popularity

5 downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

No runtime dependencies

Recent releases