node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v3.2.0 URL: https://unpkg.com/node-llama-cpp@3.2.0/dist/index.js

Open Browse Files

catai

Chat UI and Local API for the Llama models

v3.2.2 URL: https://unpkg.com/catai

Open Browse Files

llama llama-cpp bindings ai prebuilt-binaries llm gguf raspberry-pi self-hosted node-llama-cpp local catai chat

llm-interface

A simple, unified NPM-based interface for interacting with multiple Large Language Model (LLM) APIs, including OpenAI, AI21 Studio, Anthropic, Cloudflare AI, Cohere, Fireworks AI, Google Gemini, Goose AI, Groq, Hugging Face, Mistral AI, Perplexity, Reka A

v2.0.1495 URL: https://unpkg.com/llm-interface@2.0.1495/src/index.js

Open Browse Files

hyllama

llama.cpp gguf file parser for javascript

v0.2.2 URL: https://unpkg.com/hyllama@0.2.2/src/hyllama.js

Open Browse Files

llama llama.cpp llama-cpp llamacpp llm gguf parser machine learning ml

custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

v0.1.0 URL: https://unpkg.com/custom-koya-node-llama-cpp@0.1.0/dist/index.js

Open Browse Files

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda grammar json-grammar json-schema-grammar temperature topK topP json-schema raspberry-pi self-hosted local catai