Search
@lenml/tokenizers
a lightweight no-dependency fork of transformers.js (only tokenizers)
v3.4.0 URL:
https://unpkg.com/@lenml/tokenizers@3.4.0/dist/main.global.js
Open
Browse Files
llama
llama2
llama3
chatgpt
mistral
tokenizer
transformers
transformers.js
gpt4
gpt4o
gpt3.5
vicuna
chatglm
baichuan
qwen
@lenml/tokenizer-llama3
llama3 tokenizer for NodeJS/Browser
v3.4.2 URL:
https://unpkg.com/@lenml/tokenizer-llama3@3.4.2/dist/main.global.js
Open
Browse Files
llama
llama2
llama3
chatgpt
mistral
tokenizer
llama3
aicommit2
A Reactive CLI that generates git commit messages with various AI
v2.2.14 URL:
https://unpkg.com/aicommit2@2.2.14
Open
Browse Files
cli
ai
git
commit
git-commit
command-line
commandline
aipick
aicommit
aicommits
aicommit2
openai
huggingface
anthropic
claude
claude3
gemini
gemini-pro
generative-ai
mistral
ollama
llama3
llama3.2
llama3.3
gemma
llm
chatgpt
cohere
groq
codestral
perplexity
deepseek
deepseek-r1
pre-commit
@lenml/tokenizer-gemini
gemini tokenizer for NodeJS/Browser
v3.4.2 URL:
https://unpkg.com/@lenml/tokenizer-gemini@3.4.2/dist/main.global.js
Open
Browse Files
llama
llama2
llama3
chatgpt
mistral
tokenizer
gemini
@lenml/tokenizer-gpt4
gpt4 tokenizer for NodeJS/Browser
v3.4.2 URL:
https://unpkg.com/@lenml/tokenizer-gpt4@3.4.2/dist/main.global.js
Open
Browse Files
llama
llama2
llama3
chatgpt
mistral
tokenizer
gpt4