Replace tokens in a string.
A detokenizer for marklet.
Isomorphic edge tokenizer + lazy detokenizer for the Codec binary transport protocol. Works in browsers, Node 18+, and edge runtimes.
A lightweight, object-oriented **tokenizer and detokenizer** library for JavaScript and TypeScript. Works in **Node.js**, modern browsers, and via `<script>` tags.
a through stream that reads from a GLSL token object stream and writes back a stream of GLSL token strings
An MCP server for developing BASIC and Assembly Language programs for the Commodore 64
Isomorphic tokenizer + detokenizer for the Codec binary transport protocol — for Rust. Decodes streaming token IDs from Codec-compliant servers (vLLM, SGLang) and encodes text into IDs for the bidirectional path.
A generalized trie implementation for quick prefix searching.
basic dictionary based tokenization
elizaOS OpenAI Plugin - OpenAI API integration for text, image, audio, and embeddings
Extract and inspect compiled AutoIt2Exe and A3X payloads
Run-time ABI and EIP-712 implementations
Compile-time ABI and EIP-712 implementations
IMECE v0.1.0 - Local-First Autonomous Agent Framework. Zero API dependency. Zero cloud lock-in. Full sovereignty.
Run-time ABI and EIP-712 implementations
Rust bindings for llama.cpp's server with managed toolchain, typed endpoints, and UDS/HTTP support
No description provided.
No description provided.
No description provided.