node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
catai
Chat UI and Local API for the Llama models
quiad
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level