kitoken

v0.11.0npm· JavaScript

Fast tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

The verdict

Maintained. Maintained, actively maintained.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityUnknown

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published this month.

Popularity

Download count unavailable.

Security

No known advisories for this version (OSV).

License

BSD-2-Clause

Dependencies

No runtime dependencies

Recent releases