Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
β2,206Nov 18, 2026Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run AI β¨ assistant locally! with simple API for Node.js πβ499Nov 16, 2025Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inferenceβ1,397Updated this week
- State-of-the-art Machine Learning for the web. Run π€ Transformers directly in your browser, with no need for a server!β16,430Updated this week
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llamβ¦β858Aug 3, 2023Updated 3 years ago
- Ollama JavaScript libraryβ4,420Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The agent engineering platformβ18,353Updated this week
- LLM inference in C/C++β135,707Updated this week
- WebAssembly (Wasm) Build and Bindings for llama.cppβ292Jul 23, 2024Updated 2 years ago
- β98Nov 1, 2026Updated 2 weeks ago
- Data framework for your LLM applications. Focus on server side solutionβ3,080Mar 11, 2026Updated 8 months ago
- High-performance In-browser LLM Inference Engineβ19,393Updated this week
- The TypeScript library for building AI applications.β1,321Jul 19, 2024Updated 2 years ago
- LM Studio TypeScript SDKβ1,815Updated this week
- Embeddable Postgres with real-time, reactive bindings.β16,350Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A fast, efficient Node.js Worker Thread Pool implementationβ5,241Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applicationβ¦β28,036Updated this week
- Machine learning framework for Node.js.β283Apr 19, 2025Updated last year
- A vector search SQLite extension that runs anywhere!β8,272May 18, 2026Updated 6 months ago
- Mastra is the modern TypeScript framework for AI-powered applications and agents.β29,585Updated this week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.β212Updated this week
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfacesβ146Jul 9, 2024Updated 2 years ago
- Distribute and run LLMs with a single file.β26,668Nov 9, 2026Updated last week
- The official TypeScript SDK for Model Context Protocol servers and clientsβ13,788Updated this week
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Web framework built on Web Standardsβ32,995Updated this week
- Build ultra fast, tiny, and cross-platform desktop apps with TypeScript, Zig, Rust, Go, or Odin.β13,088Updated this week
- Port of OpenAI's Whisper model in C/C++β55,266Updated this week
- Python bindings for llama.cppβ10,690Updated this week
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.β50,433Updated this week
- π React for interactive command-line appsβ40,298Updated this week
- β‘οΈ TypeScript Execute | The easiest way to run TypeScript in Node.jsβ12,198Sep 25, 2026Updated last month
- BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQLβ9,611Updated this week
- The fastest and simplest library for SQLite3 in Node.js.β7,557Updated this week
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.β635Jul 20, 2026Updated 3 months ago
- Shared data types for building collaborative softwareβ23,075Updated this week
- Use Hugging Face with JavaScriptβ2,612Updated this week
- Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.β187,621Updated this week
- Incredibly fast JavaScript runtime, bundler, test runner, and package manager β all in oneβ96,767Updated this week
- π§ββοΈ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.β40,831Updated this week
- The simplest and fastest way to bundle your TypeScript libraries.β11,317Updated this week
Are these results useful?