Search results
16 packages found
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
- llama
- llama-cpp
- llama.cpp
- bindings
- ai
- cmake
- cmake-js
- prebuilt-binaries
- llm
- gguf
- metal
- cuda
- grammar
- json-grammar
- View more
Fork of llama.rn for ChatterUI
llama.cpp gguf file parser for javascript
React Native binding of llama.cpp
Node.js bindings for LlamaCPP, a C++ library for running language models.
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
- similique
- id
- llama.cpp
- bindings
- ai
- sequi
- blanditiis
- error
- llm
- laboriosam
- metal
- cuda
- grammar
- json-grammar
- View more
A library for generating syntactically valid code from an LLM.
Control what LLMs can, and can't, say
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
- llama
- llama-cpp
- llama.cpp
- bindings
- ai
- cmake
- cmake-js
- prebuilt-binaries
- llm
- gguf
- metal
- cuda
- grammar
- json-grammar
- View more
<a href="https://www.npmjs.com/package/contort"><img alt="Latest Contortionist NPM Version" src="https://badge.fury.io/js/contort.svg" /></a> <a href="https://github.com/thekevinscott/contortionist/blob/master/LICENSE"><img alt="License for contortionist"
A simple grammar builder compatible with GBNF (llama.cpp)
Local Large Language Models. Providing node.js tools to run and serve AI models on any machine.
- local ai
- inference server
- model pool
- gpt4all
- node-llama-cpp
- transformers.js
- llama.cpp
- chatbot
- bot
- llm
- ai
- nlp
- openai api
use `npm i --save llama.native.js` to run lama.cpp models on your local machine. features a socket.io server and client that can do inference with the host of the model.
llama.cpp LLM Provider
llama.cpp LLM Provider
serve websocket GGML 4/5bit Quantized LLM's based on Meta's LLaMa model with llama.ccp