gpt-tokenizer

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

v2.9.0 URL: https://unpkg.com/gpt-tokenizer@2.9.0/dist/cl100k_base.js

Open Browse Files

BPE encoder decoder tokenizer GPT GPT-2 GPT-3 GPT-3.5 GPT-4 GPT-4o NLP Natural Language Processing Text Generation OpenAI Machine Learning ml

wink-nlp

Developer friendly Natural Language Processing ✨

v2.3.2 URL: https://unpkg.com/wink-nlp@2.3.2/src/wink-nlp.js

Open Browse Files

wink-eng-lite-web-model

Wink's English Language Light Web Model for Web Browsers

v1.8.1 URL: https://unpkg.com/wink-eng-lite-web-model@1.8.1/dist/model.js

Open Browse Files

NLP Natural Language Processing English Browser wink winkjs winkNLP wink-nlp

js-rouge

Recall-Oriented Understudy for Gisting Evaluation (ROUGE) Evaluation Functions with TypeScript support

v3.0.0 URL: https://unpkg.com/js-rouge@3.0.0/dist/rouge.js

Open Browse Files

ROUGE Auto-summarization NLP TypeScript

wink-tokenizer

Multilingual tokenizer that automatically tags each token with its type

v5.3.0 URL: https://unpkg.com/wink-tokenizer@5.3.0/src/wink-tokenizer.js

Open Browse Files

Tokenizer Tokenize Tags Tagging NLP email twitter URL Emoji Emoticon Multilingual French German Spanish Icelandic wink