gpt-tokenizer

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

v2.6.2 URL: https://unpkg.com/gpt-tokenizer@2.6.2/dist/cl100k_base.js

Open Browse Files

BPE encoder decoder tokenizer GPT GPT-2 GPT-3 GPT-3.5 GPT-4 GPT-4o NLP Natural Language Processing Text Generation OpenAI Machine Learning ml

@promptbook/utils

Supercharge your use of large language models

v0.74.0-2 URL: https://unpkg.com/@promptbook/utils@0.74.0-2/umd/index.umd.js

Open Browse Files

ai llm prompt template language-model chatgpt autogpt machine-learning natural-language-processing nlp openai gpt-3 gpt-4 gpt-4o gpt-4o-mini o1 o1-mini o1-preview anthropic LLMOps

llm-api

Fully typed chat APIs for OpenAI and Azure's chat models - with token checking and retries

v1.6.0 URL: https://unpkg.com/llm-api@1.6.0/dist/src/index.js

Open Browse Files

typescript gpt chatgpt llama llm ai ml prompt prompt engineering openai

openai-tokens

A service for calculating, managing, truncating openai prompt tokens

v2.3.6 URL: https://unpkg.com/openai-tokens@2.3.6/src/index.js

Open Browse Files

openai gpt chatGPT token tokens tiktoken validate truncate models embeddings ada

openai-gpt-token-counter

Count the number of OpenAI tokens in a string. Supports all OpenAI Text models (text-davinci-003, gpt-3.5-turbo, gpt-4)

v1.1.1 URL: https://unpkg.com/openai-gpt-token-counter@1.1.1/src/index.js

Open Browse Files