node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
v3.14.2 URL: https://unpkg.com/node-llama-cpp@3.14.2/dist/index.js
OpenBrowse Files
llamallama-cppllama.cppbindingsaicmakecmake-jsprebuilt-binariesllmggufmetalcudavulkangrammarembeddingrerankrerankingjson-grammarjson-schema-grammarfunctionsfunction-callingtoken-predictionspeculative-decodingtemperatureminPtopKtopPseedjson-schemaraspberry-piself-hostedlocalcataimistraldeepseekqwenqwqgptgpt-osstypescriptlorabatchinggpu

llm-interface

A simple, unified NPM-based interface for interacting with multiple Large Language Model (LLM) APIs, including OpenAI, AI21 Studio, Anthropic, Cloudflare AI, Cohere, Fireworks AI, Google Gemini, Goose AI, Groq, Hugging Face, Mistral AI, Perplexity, Reka A
v2.0.1495 URL: https://unpkg.com/llm-interface@2.0.1495/src/index.js
OpenBrowse Files
ai21-studioai21ailayeraimlapianyscaleanthropicmicrosoft-azure-aicloudflare-aicoherecorceldeepinfradeepseekfireworks-aiforefront-aifriendliaigoogle-geminigooseaigroqhugging-facehugging-face-inferencehyperbee-ailaminillama-cppmistral-aimonster-apineets-ainovita-ainvidia-aioctoaiollamaopenaiperplexity-aireka-aireplicateshuttle-aitheb-aitogether-aivoyage-aiwatsonx-aiwriterzhipu-ai

hyllama

llama.cpp gguf file parser for javascript
v0.2.2 URL: https://unpkg.com/hyllama@0.2.2/src/hyllama.js
OpenBrowse Files
llamallama.cppllama-cppllamacppllmggufparsermachine learningml

catai

Chat UI and Local API for the Llama models
v3.2.2 URL: https://unpkg.com/catai@3.2.2/dist/index.js
OpenBrowse Files
llamallama-cppbindingsaiprebuilt-binariesllmggufraspberry-piself-hostednode-llama-cpplocalcataichat

@aibrow/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
v1.7.0 URL: https://unpkg.com/@aibrow/node-llama-cpp@1.7.0/dist/index.js
OpenBrowse Files
llamallama-cppllama.cppbindingsaicmakecmake-jsprebuilt-binariesllmggufmetalcudavulkangrammarembeddingrerankrerankingjson-grammarjson-schema-grammarfunctionsfunction-callingtoken-predictionspeculative-decodingtemperatureminPtopKtopPseedjson-schemaraspberry-piself-hostedlocalcataimistraldeepseekqwenqwqtypescriptlorabatchinggpu