@jill64/cf-tiktoken

⏳ js-tiktoken on Cloudflare Pages

v1.0.11 URL: https://unpkg.com/@jill64/cf-tiktoken@1.0.11/dist/edge.js

Open Browse Files

bpe cloudflare gpt llm pages tiktoken

n8n-nodes-gpt-tiktoken

n8n node for working with BPE Tokens with OpenAI's GPT models in mind.

v0.1.25 URL: https://unpkg.com/n8n-nodes-gpt-tiktoken@0.1.25/index.js

Open Browse Files

n8n-community-node-package n8n nodemation n8n-node gpt bpe tokenizer

n8n-nodes-gpt-tokenizer

n8n node for working with BPE Tokens with OpenAI's GPT models in mind.

v0.1.1 URL: https://unpkg.com/n8n-nodes-gpt-tokenizer@0.1.1/index.js

Open Browse Files

n8n-community-node-package n8n nodemation n8n-node gpt bpe tokenizer

@dvdagames/pgn-tokenizer

TypeScript version of PGN Tokenizer, a Byte Pair Encoding (BPE) tokenizer for Chess Portable Game Notiation (PGN).

v0.1.6 URL: https://unpkg.com/@dvdagames/pgn-tokenizer@0.1.6/dist/index.js

Open Browse Files

chess tokenizer pgn byte pair encoding bpe llm tokenizers

kitoken

Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

v0.10.1 URL: https://unpkg.com/kitoken@0.10.1/dist/index.js

Open Browse Files

tokenizer nlp bpe unigram wordpiece