Fast JavaScript array sorting by implementing Python's Timsort algorithm
Tests for CSS Tokenizers
The API for building streaming tokenizers and lexers.
HTTP tokenizer for Node.js and browser
Turn anything into an array
Loop over each item in an array and call the given function on every element.
Stringify your JSON at max speed
Array-slice method. Slices `array` from the `start` index up to, but not including, the `end` index.
`Array#forEach()` but it’s possible to define where to move to next
Split text into sentences with Sentence Boundary Detection (SBD).
Javascript text tokenizer that is easy to use and compose
A fast tokenizer/lexer for JavaScript
Efficient Binary heap (priority queue, binary tree) data structure for JavaScript / TypeScript. Includes JavaScript methods, Python's heapq module methods, and Java's PriorityQueue methods.
Our library `@lenml/llama2-tokenizer` has been deprecated. We are excited to introduce our new library `@lenml/tokenizers` as its replacement, offering a broader set of features and an enhanced experience.
utilities for primitive JavaScript types
Array utils
Simple HTML Tokenizer is a lightweight JavaScript library that can be used to tokenize the kind of HTML normally found in templates.
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
Pure-TypeScript CSS toolkit for Bun/Node — parser, walker, generator, selector engine, and minifier. Zero runtime deps.
yi tokenizer for NodeJS/Browser
Forked version of kuromoji with better compatibility for browsers
Utility package to determine if an `Array.prototype` method properly boxes the callback's receiver and third argument.
Concatenate a readable stream's data into a single array
Rope-based persistent sequence type