tiktoken-data

v0.1.1npm· JavaScript

BPE tokenizer data files for LLMs (o200k_base, cl100k_base, DeepSeek V3/V2)

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published this month.

Popularity

30 downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

No runtime dependencies

Recent releases