pragmatic_tokenizer
v3.2.1RubyGems· RubyA multilingual tokenizer to split a string into tokens.
The verdict
Abandoned. Last published over a year ago. No recent activity — look for a maintained alternative.
No recent activity — look for a maintained alternative.
Live from the RubyGems registry · derived rules, not AI
How it scores
MaintenanceAbandoned
PopularityNiche
SecurityClean
LicenseUnknown
DepsZero deps
Maintenance
Last published over a year ago.
Popularity
374 downloads / week
Security
No known advisories for this version (OSV).
License
No license declared.
Dependencies
No runtime dependencies
Recent releases
- 3.2.1over a year ago
- 3.2.05 years ago
- 3.1.05 years ago
- 3.0.78 years ago
- 3.0.68 years ago
- 3.0.58 years ago
- 3.0.410 years ago
- 2.2.110 years ago