Search

js-tokens

Tiny JavaScript tokenizer.

v9.0.0 URL: https://unpkg.com/js-tokens@9.0.0/index.js

OpenBrowse Files

JavaScriptjsECMAScriptestokentokenstokenizetokenizerregexregexp

hast-util-from-html

hast utility to parse from HTML

v2.0.3 URL: https://unpkg.com/hast-util-from-html@2.0.3/index.js

OpenBrowse Files

unisthasthast-utilutilutilityhtmlparsetokenize

micromark-util-subtokenize

micromark utility to tokenize subtokens

v2.0.2 URL: https://unpkg.com/micromark-util-subtokenize@2.0.2/index.js

OpenBrowse Files

micromarkutilutilitytokenize

wink-nlp

Developer friendly Natural Language Processing ✨

v2.3.0 URL: https://unpkg.com/wink-nlp@2.3.0/src/wink-nlp.js

OpenBrowse Files

NLPnatural language processingtokenizeSBDsentence boundary detectionnegation handlingsentiment analysisPOS TaggingNERnamed entity extractioncustom entity detectionword vectorsvisualizationpattern matchingstemmerbm25vectorizerEmbeddingsWord VectorswinkNLPwinkjswink

@stdlib/string-base-format-tokenize

Tokenize a string into an array of string parts and format identifier objects.

v0.2.2 URL: https://unpkg.com/@stdlib/string-base-format-tokenize@0.2.2/lib/index.js

OpenBrowse Files

stdlibstdstringutilitiesutilityutilsutilstringstrformatformattingfmttokenstokenizetoken