An ES7/ES2016 spec-compliant `Array.prototype.includes` shim/polyfill/replacement that works as far down as ES3.
A simple list of possible Typed Array names.
gemini tokenizer for NodeJS/Browser
Is this value a JS SharedArrayBuffer?
Is this value a JS ArrayBuffer?
Robustly get the byte offset of a Typed Array
`Array.prototype.concat`, but made safe by ignoring Symbol.isConcatSpreadable
Get the byte length of an ArrayBuffer, even in engines without a `.byteLength` method.
Robustly get the byte length of a Typed Array
Get the ArrayBuffer out of a TypedArray, robustly.
Robustly get the length of a Typed Array
Multi-arch builds of HuggingFace tokenizers
TypeScript definitions for wink-tokenizer
General purpose glob-based configuration matching.
A simple, Twitter-aware tokenizer.
Is this value a JS Typed Array? This module works cross-realm/iframe, does not depend on `instanceof` or mutable properties, and despite ES6 Symbol.toStringTag.
Convert SQL statements into a list of tokens
Parse postgres array columns
Run an array of functions in parallel
<header> <h1 align="center"> <a href="https://github.com/yozorajs/yozora/tree/v2.3.13/packages/core-parser#readme">@yozora/core-parser</a> </h1> <div align="center"> <a href="https://www.npmjs.com/package/@yozora/core-parser"> <img
Flatten nested arrays
JS tokenizer for Mistral-based LLMs
deepseek_v3 tokenizer for NodeJS/Browser
Fork of @lexical/code with Prism.js syntax highlighting removed. Drop-in replacement for @lexical/code.