node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
v3.14.2 URL: https://unpkg.com/node-llama-cpp@3.14.2/dist/index.js
OpenBrowse Files
llamallama-cppllama.cppbindingsaicmakecmake-jsprebuilt-binariesllmggufmetalcudavulkangrammarembeddingrerankrerankingjson-grammarjson-schema-grammarfunctionsfunction-callingtoken-predictionspeculative-decodingtemperatureminPtopKtopPseedjson-schemaraspberry-piself-hostedlocalcataimistraldeepseekqwenqwqgptgpt-osstypescriptlorabatchinggpu

llama.rn

React Native binding of llama.cpp
v0.8.0 URL: https://unpkg.com/llama.rn@0.8.0/lib/commonjs/index.js
OpenBrowse Files
react-nativeiosandroidlarge language modelLLMLocal LLMllama.cppllamallama-2

@fugood/llama.node

An another Node binding of llama.cpp
v1.3.0 URL: https://unpkg.com/@fugood/llama.node@1.3.0/lib/index.js
OpenBrowse Files
llamallmaigenaiLocal LLMllama.cpp

@fugood/node-llama-linux-x64

Native module for An another Node binding of llama.cpp (linux-x64)
v1.3.0 URL: https://unpkg.com/@fugood/node-llama-linux-x64@1.3.0/index.node
OpenBrowse Files
llamallmaigenaiLocal LLMllama.cpplinuxx64native

@fugood/node-llama-linux-arm64

Native module for An another Node binding of llama.cpp (linux-arm64)
v1.3.0 URL: https://unpkg.com/@fugood/node-llama-linux-arm64@1.3.0/index.node
OpenBrowse Files
llamallmaigenaiLocal LLMllama.cpplinuxarm64native