tiktoken
v3.1.4crates.io· RustA high-performance pure-Rust implementation of OpenAI's tiktoken BPE tokenizer
The verdict
Maintained. Niche but maintained, actively maintained.
Live from the crates.io registry · derived rules, not AI
How it scores
MaintenanceHealthy
PopularityNiche
SecurityClean
LicensePermissive
DepsZero deps
Maintenance
Last published 1 month ago.
Popularity
455 downloads / week
Security
No known advisories for this version (OSV).
License
MIT
Dependencies
No runtime dependencies
Recent releases
- 3.1.41 month ago
- 3.1.31 month ago
- 3.1.23 months ago
- 3.1.13 months ago
- 3.1.03 months ago
- 3.0.13 months ago
- 3.0.03 months ago
- 2.1.13 months ago