node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v3.2.0 URL: https://unpkg.com/node-llama-cpp@3.2.0/dist/index.js

Open Browse Files

catai

Chat UI and Local API for the Llama models

v3.2.2 URL: https://unpkg.com/catai@3.2.2/dist/index.js

Open Browse Files

llama llama-cpp bindings ai prebuilt-binaries llm gguf raspberry-pi self-hosted node-llama-cpp local catai chat

custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

v0.1.0 URL: https://unpkg.com/custom-koya-node-llama-cpp@0.1.0/dist/index.js

Open Browse Files

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda grammar json-grammar json-schema-grammar temperature topK topP json-schema raspberry-pi self-hosted local catai