tokengeex

v1.1.0PyPI· Python

TokenGeeX is an efficient tokenizer for code based on UnigramLM and TokenMonster.

The verdict

Abandoned. Last published 2 years ago. No recent activity — look for a maintained alternative.

No recent activity — look for a maintained alternative.

Live from the PyPI registry · derived rules, not AI

How it scores

MaintenanceAbandoned

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 2 years ago.

Popularity

11 downloads / week

Security

No known advisories for this version (OSV).

License

Apache-2.0

Dependencies

No runtime dependencies

Recent releases