gs-tokenizer

v0.1.21npm· JavaScript

A powerful and lightweight multilingual tokenizer library that provides natural language processing capabilities for multiple languages including English, Chinese, Japanese, and Korean.

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 5 months ago.

Popularity

5 downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

No runtime dependencies

Recent releases

0.1.215 months ago
0.1.205 months ago
0.1.195 months ago
0.1.185 months ago
0.1.175 months ago
0.1.165 months ago
0.1.155 months ago
0.1.145 months ago