tokenizers

v0.7.0RubyGems· Ruby

Fast state-of-the-art tokenizers for Ruby

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the RubyGems registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 1 month ago.

Popularity

63 downloads / week

Security

No known advisories for this version (OSV).

License

Apache-2.0

Dependencies

No runtime dependencies

Recent releases