BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us

ru_token

v0.1.23RubyGems· Ruby

[DEPRECATED] switch to 'j_r_r_token'. RuToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, and r50k_base.

The verdict
Aging — last published 10 months ago — check before adopting. Check the repo for activity before adopting.
Check the repo for activity before adopting.
Live from the RubyGems registry · derived rules, not AI
How it scores
MaintenanceAging
PopularityNiche
SecurityClean
LicensePermissive
DepsZero deps
Maintenance
Last published 10 months ago — check before adopting.
Popularity
58 downloads / week
Security
No known advisories for this version (OSV).
License
MIT
Dependencies
No runtime dependencies
Recent releases
  • 0.1.2310 months ago
  • 0.1.2210 months ago
  • 0.1.2110 months ago
  • 0.1.2010 months ago
  • 0.1.1910 months ago
  • 0.1.1810 months ago
  • 0.1.1710 months ago
  • 0.1.1610 months ago
ru_token — [DEPRECATED] switch to 'j_r_r_token'. RuToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, and r50k_base. (Ruby / RubyGems) · Modules