Search

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v3.10.0 URL: https://unpkg.com/node-llama-cpp@3.10.0/dist/index.js

OpenBrowse Files

llamallama-cppllama.cppbindingsaicmakecmake-jsprebuilt-binariesllmggufmetalcudavulkangrammarembeddingrerankrerankingjson-grammarjson-schema-grammarfunctionsfunction-callingtoken-predictionspeculative-decodingtemperatureminPtopKtopPseedjson-schemaraspberry-piself-hostedlocalcataimistraldeepseekqwenqwqtypescriptlorabatchinggpu

@aibrow/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v1.5.0 URL: https://unpkg.com/@aibrow/node-llama-cpp@1.5.0/dist/index.js

OpenBrowse Files

llamallama-cppllama.cppbindingsaicmakecmake-jsprebuilt-binariesllmggufmetalcudavulkangrammarembeddingrerankrerankingjson-grammarjson-schema-grammarfunctionsfunction-callingtoken-predictionspeculative-decodingtemperatureminPtopKtopPseedjson-schemaraspberry-piself-hostedlocalcataimistraldeepseekqwenqwqtypescriptlorabatchinggpu