tokenx

Fast and lightweight token estimation for any LLM without requiring a full tokenizer

v1.1.0 URL: https://unpkg.com/tokenx@1.1.0/dist/index.js

Open Browse Files

ai llm token tokenizer estimation tiktoken anthropic openai

gpt-tokens

Calculate the token consumption and amount of openai gpt message

v1.3.14 URL: https://unpkg.com/gpt-tokens@1.3.14/dist/index.js

Open Browse Files

gpt chatGPT openai tiktoken token tokens consumption amount

vg-coder-cli

🚀 CLI tool to analyze projects, concatenate source files, count tokens, and export HTML with syntax highlighting and copy functionality

v1.0.8 URL: https://unpkg.com/vg-coder-cli@1.0.8/src/index.js

Open Browse Files

cli code-analysis token-counter ai-helper gitignore html-export syntax-highlighting project-analyzer source-code tiktoken spring-boot angular react vue java javascript typescript

openai-tokens

A service for calculating, managing, truncating openai prompt tokens

v2.3.6 URL: https://unpkg.com/openai-tokens@2.3.6/src/index.js

Open Browse Files

openai gpt chatGPT token tokens tiktoken validate truncate models embeddings ada

tiktokend

High-level binding to tiktoken-rs for Node.js and browsers

v1.0.2 URL: https://unpkg.com/tiktokend@1.0.2/index.js

Open Browse Files

openai tokenizer tiktoken-rs tiktoken tiktoken-js tiktoken-node tiktoken-browser tiktoken-wasm tiktoken-wasi tiktoken-wasi-browser