Tiny JavaScript tokenizer.
Tokenize CSS
A promise based streaming tokenizer
Tokenized zip support
A regular expression to match all Emoji-only symbols as per the Unicode Standard.
TypeScript definition for strtok3 token
Give a regex, get a robust predicate function that tests it against a string.
Algorithms to help you parse CSS from an array of tokens.
Is this value a JS regex? Works cross-realm/iframe, and despite ES6 @@toStringTag
Pass two numbers, get a regex-compatible source string for matching ranges. Validated against more than 2.78 million test assertions.
Compile ES2015 Unicode regex to ES5
Parses and stringifies CSS selectors
Compile ES2015 sticky regex to an ES5 RegExp constructor
Compile regular expressions using named groups to ES5.
Regular expression for matching ANSI escape codes
Regular expression for matching a shebang line
Compile Unicode property escapes in Unicode regular expressions to ES5.
Compile regular expressions using the `s` (`dotAll`) flag to ES5.
Solve CSS math expressions
Compile regular expressions' unicodeSets (v) flag.
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
A tokenzier for Sass' SCSS syntax
Compile regular expressions using duplicate named groups to index-based groups.
Solana wallet adapter implementation for Fractal Wallet