@sctg/sentencepiece-js

Sentencepiece tokenization for natural language processing, JS version.

v1.3.3 URL: https://unpkg.com/@sctg/sentencepiece-js@1.3.3/dist/index.js

Open Browse Files

machine_learning albert nlp sentencepiece

nai-js-tokenizer

BPE tokenizer used for the NovelAI frontend.

v1.1.0 URL: https://unpkg.com/nai-js-tokenizer@1.1.0/lib/index.js

Open Browse Files

gpt gpt2 pile sentencepiece nerdstash tokenizer novelai

@lambda_x/sptk

Sentencepiece tokenization for natural language processing, JS version.

v1.1.3 URL: https://unpkg.com/@lambda_x/sptk@1.1.3/dist/index.js

Open Browse Files

machine_learning albert nlp sentencepiece

@agnai/sentencepiece-js

Sentencepiece tokenization for natural language processing, JS version.

v1.1.1 URL: https://unpkg.com/@agnai/sentencepiece-js@1.1.1/dist/index.js

Open Browse Files

machine_learning albert nlp sentencepiece

sentencepiece-js

Sentencepiece tokenization for natural language processing, JS version.

v1.1.0 URL: https://unpkg.com/sentencepiece-js@1.1.0/dist/index.js

Open Browse Files

machine_learning albert nlp sentencepiece