js-tokens

Tiny JavaScript tokenizer.

v9.0.1 URL: https://unpkg.com/js-tokens@9.0.1/index.js

Open Browse Files

JavaScript js ECMAScript es token tokens tokenize tokenizer regex regexp

css-tree

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

v3.1.0 URL: https://unpkg.com/css-tree@3.1.0/dist/csstree.esm.js

Open Browse Files

css ast tokenizer parser walker lexer generator utils syntax validation

strtok3

A promise based streaming tokenizer

v10.3.1 URL: https://unpkg.com/strtok3@10.3.1/lib/core.js

Open Browse Files

tokenizer reader token async promise parser decoder binary endian uint stream streaming

ret

Tokenizes a string that represents a regular expression.

v0.5.0 URL: https://unpkg.com/ret@0.5.0/dist/index.js

Open Browse Files

regex regexp regular expression parser tokenizer

micromark

small commonmark compliant markdown parser with positional info and concrete tokens

v4.0.2 URL: https://unpkg.com/micromark@4.0.2/index.js

Open Browse Files

commonmark compiler gfm html lexer markdown markup md unified parse parser plugin process remark render renderer token tokenizer