oxibonsai-tokenizer
v0.2.0crates.io· RustPure Rust BPE tokenizer for OxiBonsai (MeCrab-compatible)
The verdict
Maintained. Niche but maintained, actively maintained.
Live from the crates.io registry · derived rules, not AI
How it scores
MaintenanceHealthy
PopularityNiche
SecurityClean
LicensePermissive
DepsZero deps
Maintenance
Last published this month.
Popularity
32 downloads / week
Security
No known advisories for this version (OSV).
License
Apache-2.0
Dependencies
No runtime dependencies
Recent releases
- 0.2.0this month
- 0.1.5this month
- 0.1.4this month
- 0.1.31 month ago
- 0.1.21 month ago
- 0.1.11 month ago
- 0.1.01 month ago