Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,952Mar 17, 2026Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆485Nov 16, 2025Updated 4 months ago
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆867Aug 3, 2023Updated 2 years ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,548Updated this week
- Ollama JavaScript library☆4,071Feb 18, 2026Updated last month
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,016Dec 17, 2025Updated 3 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆287Jul 23, 2024Updated last year
- The agent engineering platform☆17,206Mar 14, 2026Updated last week
- LLM inference in C/C++☆98,098Updated this week
- The TypeScript library for building AI applications.☆1,316Jul 19, 2024Updated last year
- Data framework for your LLM applications. Focus on server side solution☆3,066Mar 11, 2026Updated last week
- React Native binding of llama.cpp☆868Mar 8, 2026Updated last week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆201Dec 15, 2025Updated 3 months ago
- High-performance In-browser LLM Inference Engine☆17,567Mar 13, 2026Updated last week
- Machine learning framework for Node.js.☆281Apr 19, 2025Updated 11 months ago
- A fast, efficient Node.js Worker Thread Pool implementation☆5,089Mar 9, 2026Updated last week
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆141Jul 9, 2024Updated last year
- LLama.cpp rust bindings☆418Jun 27, 2024Updated last year
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆590Feb 19, 2026Updated last month
- Distribute and run LLMs with a single file.☆23,794Mar 14, 2026Updated last week
- Embeddable Postgres with real-time, reactive bindings.☆14,900Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆22,639Updated this week
- Local AI API Platform☆2,761Jul 4, 2025Updated 8 months ago
- Web framework built on Web Standards☆29,354Mar 14, 2026Updated last week
- Python bindings for llama.cpp☆10,058Aug 15, 2025Updated 7 months ago
- From the team behind Gatsby, Mastra is a framework for building AI-powered applications and agents with a modern TypeScript stack.☆22,064Updated this week
- Official JavaScript / TypeScript library for the OpenAI API☆10,739Updated this week
- The official TypeScript SDK for Model Context Protocol servers and clients☆11,851Updated this week
- LM Studio TypeScript SDK☆1,545Updated this week
- Node.js binding of llama.cpp☆19Mar 11, 2026Updated last week
- ⚡️ TypeScript Execute | The easiest way to run TypeScript in Node.js☆11,869Feb 13, 2026Updated last month
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆165,557Updated this week
- BullMQ - Message Queue and Batch processing for NodeJS, Python, Elixir and PHP based on Redis☆8,567Updated this week
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆431Mar 1, 2026Updated 2 weeks ago
- A vector search SQLite extension that runs anywhere!☆7,159Mar 13, 2026Updated last week
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,827Updated this week
- The simplest and fastest way to bundle your TypeScript libraries.☆11,164Feb 28, 2026Updated 2 weeks ago
- Port of OpenAI's Whisper model in C/C++☆47,689Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,237Feb 13, 2026Updated last month
- A Next.js chat app to use Llama 2 locally using node-llama-cpp☆12Oct 27, 2024Updated last year