Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆2,196Oct 20, 2026Updated last week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆498Nov 16, 2025Updated 11 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,352Oct 20, 2026Updated last week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,388Updated this week
- Ollama JavaScript library☆4,404Oct 16, 2026Updated 2 weeks ago
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆855Aug 3, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The agent engineering platform☆18,306Updated this week
- LLM inference in C/C++☆132,630Updated this week
- ☆97Oct 22, 2026Updated last week
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆292Jul 23, 2024Updated 2 years ago
- High-performance In-browser LLM Inference Engine☆19,329Oct 11, 2026Updated 2 weeks ago
- Data framework for your LLM applications. Focus on server side solution☆3,082Mar 11, 2026Updated 7 months ago
- The TypeScript library for building AI applications.☆1,320Jul 19, 2024Updated 2 years ago
- LM Studio TypeScript SDK☆1,805Updated this week
- Embeddable Postgres with real-time, reactive bindings.☆16,211Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A fast, efficient Node.js Worker Thread Pool implementation☆5,229Oct 19, 2026Updated last week
- Machine learning framework for Node.js.☆283Apr 19, 2025Updated last year
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆27,605Updated this week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆212Updated this week
- A vector search SQLite extension that runs anywhere!☆8,226May 18, 2026Updated 5 months ago
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆29,189Updated this week
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- Distribute and run LLMs with a single file.☆26,520Oct 12, 2026Updated 2 weeks ago
- Web framework built on Web Standards☆32,746Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The official TypeScript SDK for Model Context Protocol servers and clients☆13,674Updated this week
- Port of OpenAI's Whisper model in C/C++☆54,763Updated this week
- Python bindings for llama.cpp☆10,666Oct 1, 2026Updated 3 weeks ago
- Build ultra fast, tiny, and cross-platform desktop apps with TypeScript, Zig, Rust, Go, or Odin.☆12,985Updated this week
- Use Hugging Face with JavaScript☆2,588Updated this week
- BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL☆9,559Updated this week
- 🌈 React for interactive command-line apps☆40,196Updated this week
- The fastest and simplest library for SQLite3 in Node.js.☆7,535Aug 10, 2026Updated 2 months ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆633Jul 20, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆50,046Updated this week
- Shared data types for building collaborative software☆22,996Oct 23, 2026Updated last week
- ⚡️ TypeScript Execute | The easiest way to run TypeScript in Node.js☆12,179Sep 25, 2026Updated last month
- Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆185,220Updated this week
- Official JavaScript / TypeScript library for the OpenAI API☆11,242Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,745Updated this week
- The simplest and fastest way to bundle your TypeScript libraries.☆11,298Updated this week