polyglot-tokenizer

v2.0.2PyPI· Python

Tokenizer for world's most spoken languages and social media texts like Facebook, Twitter etc.

The verdict

Abandoned. Last published 4 years ago. No recent activity — look for a maintained alternative.

No recent activity — look for a maintained alternative.

Live from the PyPI registry · derived rules, not AI

How it scores

MaintenanceAbandoned

PopularityNiche

SecurityClean

LicensePermissive

DepsLean

Maintenance

Last published 4 years ago.

Popularity

19 downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

2 direct dependencies

Recent releases