node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v3.2.0 URL: https://unpkg.com/node-llama-cpp@3.2.0/dist/index.js

Open Browse Files

catai

Chat UI and Local API for the Llama models

v3.2.2 URL: https://unpkg.com/catai@3.2.2/dist/index.js

Open Browse Files

llama llama-cpp bindings ai prebuilt-binaries llm gguf raspberry-pi self-hosted node-llama-cpp local catai chat

hyllama

llama.cpp gguf file parser for javascript

v0.2.2 URL: https://unpkg.com/hyllama@0.2.2/src/hyllama.js

Open Browse Files

llama llama.cpp llama-cpp llamacpp llm gguf parser machine learning ml

@huggingface/gguf

a GGUF parser that works on remotely hosted files

v0.1.12 URL: https://unpkg.com/@huggingface/gguf@0.1.12/dist/index.js

Open Browse Files

huggingface hub gguf

custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

v0.1.0 URL: https://unpkg.com/custom-koya-node-llama-cpp@0.1.0/dist/index.js

Open Browse Files

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda grammar json-grammar json-schema-grammar temperature topK topP json-schema raspberry-pi self-hosted local catai