Lexes ES modules returning their import/export metadata
Lexes CommonJS modules, returning their named exports metadata
The pug lexer (takes a string and converts it to an array of tokens)
lexing json
A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations
@ts-jison/common: ==== ----------------------------------------- A parser/lexer run-time library used by [@ts-jison/parser](../parser) and [@ts-jison/lexer](../lexer).
@ts-jison/lexer: ==== ----------------------------------------- A parser run-time library used by [@ts-jison/parser-generator](../parser-generator).
A JavaScript library for escaping CSS strings and identifiers while generating the shortest possible ASCII-only output.
@ts-jison/parser: ==== A lightly-typescriptified API for creating parsers in JavaScript ----------------------------------------- A lexical analyzer generator used by [@ts-jison/lexer-generator](../lexer-generator).
MermaidJS parser
Optimised tokenizer/lexer generator! 🐄 Much performance. Moo!
ES module parser powered by Rust
Edge parser to convert text markup to lexer tokens
This is the Linux 64-bit binary for rs-module-lexer.
This is the Linux 64-bit (musl) binary for rs-module-lexer.
For ruby and ruby on rails
XML Lexer
> A lossless Twig lexer
The lexer for Materialize's SQL dialect, with wasm build targets.
Core components of Traqula
This is the macOS 64-bit binary for rs-module-lexer.
This is the Linux ARM 64-bit binary for rs-module-lexer.
Lexer / tokenizer
This is the Linux ARM 32-bit binary for rs-module-lexer.
A library for tokenizing, lexing, and parsing Ruby regular expressions.
A simple toy lexer for Ruby
RubyLexer is a lexer library for Ruby, written in Ruby. Rubylexer is meant as a lexer for Ruby that's complete and correct; all legal Ruby code should be lexed correctly by RubyLexer as well. Just enough parsing capability is included to give RubyLexer enough context to tokenize correctly in all cases. (This turned out to be more parsing than I had thought or wanted to take on at first.) RubyLexer handles the hard things like complicated strings, the ambiguous nature of some punctuation characters and keywords in ruby, and distinguishing methods and local variables. It should be able to correctly lex 99.9+% of legal ruby code.
This gem implements a runtime for ANTLR4 in Ruby for lexers and parsers generated using the Ruby language target.
pygments.rb exposes the pygments syntax highlighter to Ruby
LexerKit is a high performance lexer toolkit for Ruby
A simple HTML lexer/tokenizer written in Ruby.
Implements a simple lexer using a StringScanner
The Ruby Language Toolkit provides classes for creating context-free grammars, lexers, parsers, and abstract syntax trees.
Full power of Java's ANTLR 3 language recognition tool brought to Ruby. Generate lexers, parsers, tree parsers, source translators, and language analysis tools for use in Ruby applications.
== Rouge::Lexers::Wenyan {Rouge}[https://github.com/rouge-ruby/rouge] lexer for {Wenyan}[https://wy-lang.org/], programming language for the ancient Chinese.
Ruby implementation of the Antlr4 runtime. This is needed by any parser/lexer written in Antlr4 using the target langague=Ruby.