Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
☆855Aug 3, 2023Updated 3 years ago
Alternatives and similar repositories for llama-node
Users that are interested in llama-node are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JavaScript bindings for the ggml-js library☆44Nov 10, 2025Updated 11 months ago
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆2,197Oct 20, 2026Updated last week
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,150Jun 24, 2024Updated 2 years ago
- Enhancing LangChain prompts to work better with RWKV models☆32May 30, 2023Updated 3 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,590Mar 23, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- gpt4all and llama typescript bindings☆397Mar 16, 2024Updated 2 years ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆314Jan 31, 2024Updated 2 years ago
- The agent engineering platform☆18,315Updated this week
- An LLM playground you can run on your laptop☆6,344Feb 6, 2026Updated 8 months ago
- High-performance In-browser LLM Inference Engine☆19,343Updated this week
- Use self-hosted LLMs with an OpenAI compatible API☆64Apr 1, 2024Updated 2 years ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,397Updated this week
- The simplest way to run LLaMA on your local machine☆12,873Jun 18, 2024Updated 2 years ago
- Tensor library for machine learning☆272Apr 23, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU☆3,765Sep 30, 2023Updated 3 years ago
- C++ implementation for BLOOM☆808May 13, 2023Updated 3 years ago
- Run LLAMA LLMs in Node with Langchain☆39Apr 11, 2023Updated 3 years ago
- Bleeding edge low level Rust binding for GGML☆18Jun 26, 2024Updated 2 years ago
- ☆13Jun 3, 2023Updated 3 years ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,077Sep 20, 2023Updated 3 years ago
- LLM inference in C/C++☆133,099Updated this week
- Python bindings for llama.cpp☆199Apr 22, 2023Updated 3 years ago
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆916Jul 22, 2025Updated last year
- C++ implementation for 💫StarCoder☆459Sep 9, 2023Updated 3 years ago
- Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.☆3,788Jan 12, 2024Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆307Aug 5, 2024Updated 2 years ago
- Tensor library for machine learning☆15,566Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆77,346May 27, 2025Updated last year
- Python bindings for llama.cpp☆10,667Oct 1, 2026Updated last month
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆74Aug 19, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆498Nov 16, 2025Updated 11 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,549May 1, 2026Updated 6 months ago
- Chatbot that answers frequently asked questions in French, English, and Tunisian using the Rasa NLU framework and RWKV-4-Raven☆13May 19, 2023Updated 3 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 3 years ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆553Feb 12, 2024Updated 2 years ago
- Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().☆699Jun 27, 2023Updated 3 years ago