tokenizer

v3.6.2PyPI· Python

A fast, compact pure-Python tokenizer for Icelandic text with sentence segmentation

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the PyPI registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsModerate

Maintenance

Last published 6 months ago.

Popularity

8.5K downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

7 direct dependencies

Recent releases