shimmytok

v0.7.1crates.io· Rust

Pure Rust tokenizer for GGUF models with llama.cpp compatibility (SentencePiece + BPE + WPM + UGM + RWKV)

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the crates.io registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published this month.

Popularity

209 downloads / week

Security

No known advisories for this version (OSV).

License

Apache-2.0 OR MIT

Dependencies

No runtime dependencies

Recent releases