Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,904Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆869Aug 3, 2023Updated 2 years ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,432Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆484Nov 16, 2025Updated 3 months ago
- Ollama JavaScript library☆4,010Feb 18, 2026Updated last week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,003Dec 17, 2025Updated 2 months ago
- 🦜🔗 Build context-aware reasoning applications☆17,018Updated this week
- The TypeScript library for building AI applications.☆1,316Jul 19, 2024Updated last year
- Data framework for your LLM applications. Focus on server side solution☆3,058Feb 20, 2026Updated last week
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆285Jul 23, 2024Updated last year
- LLM inference in C/C++☆95,726Updated this week
- High-performance In-browser LLM Inference Engine☆17,398Feb 18, 2026Updated last week
- Machine learning framework for Node.js.☆279Apr 19, 2025Updated 10 months ago
- ☆77Feb 19, 2026Updated last week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆198Dec 15, 2025Updated 2 months ago
- A demonstration Electron app using node-llama-cpp☆22Dec 6, 2023Updated 2 years ago
- A fast, efficient Node.js Worker Thread Pool implementation☆5,054Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆21,971Updated this week
- From the team behind Gatsby, Mastra is a framework for building AI-powered applications and agents with a modern TypeScript stack.☆21,376Updated this week
- Distribute and run LLMs with a single file.☆23,742Updated this week
- Official JavaScript / TypeScript library for the OpenAI API☆10,665Updated this week
- Web framework built on Web Standards☆28,960Updated this week
- ⚡️ TypeScript Execute | The easiest way to run TypeScript in Node.js☆11,809Feb 13, 2026Updated 2 weeks ago
- Local AI API Platform☆2,758Jul 4, 2025Updated 7 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆141Jul 9, 2024Updated last year
- Embeddable Postgres with real-time, reactive bindings.☆14,727Feb 10, 2026Updated 2 weeks ago
- BullMQ - Message Queue and Batch processing for NodeJS, Python, Elixir and PHP based on Redis☆8,463Updated this week
- The official TypeScript SDK for Model Context Protocol servers and clients☆11,655Updated this week
- LM Studio TypeScript SDK☆1,494Updated this week
- LLama.cpp rust bindings☆414Jun 27, 2024Updated last year
- Python bindings for llama.cpp☆10,003Aug 15, 2025Updated 6 months ago
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,172Feb 13, 2026Updated 2 weeks ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆163,045Feb 21, 2026Updated last week
- Port of OpenAI's Whisper model in C/C++☆47,067Updated this week
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,070Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆39,613Updated this week
- TypeScript-first schema validation with static type inference☆41,918Feb 15, 2026Updated last week
- The simplest and fastest way to bundle your TypeScript libraries.☆11,134Feb 20, 2026Updated last week
- The fastest and simplest library for SQLite3 in Node.js.☆6,949Jan 19, 2026Updated last month
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆590Feb 19, 2026Updated last week