ai-tokenizer

v1.0.6npm· JavaScript

A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.

The verdict

Worth a look. Actively maintained and growing, actively maintained.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityRising

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 6 months ago.

Popularity

63K downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

No runtime dependencies

Recent releases