Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆2,167Aug 11, 2026Updated 2 weeks ago
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,189Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆499Nov 16, 2025Updated 9 months ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,278Updated this week
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆859Aug 3, 2023Updated 3 years ago
- Ollama JavaScript library☆4,358Feb 18, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The agent engineering platform☆18,145Updated this week
- LLM inference in C/C++☆126,367Updated this week
- ☆95Aug 5, 2026Updated 3 weeks ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆294Jul 23, 2024Updated 2 years ago
- The TypeScript library for building AI applications.☆1,319Jul 19, 2024Updated 2 years ago
- LM Studio TypeScript SDK☆1,763Updated this week
- Data framework for your LLM applications. Focus on server side solution☆3,075Mar 11, 2026Updated 5 months ago
- High-performance In-browser LLM Inference Engine☆18,613Aug 4, 2026Updated 3 weeks ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆26,497Updated this week
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆27,573Updated this week
- A vector search SQLite extension that runs anywhere!☆8,056May 18, 2026Updated 3 months ago
- Distribute and run LLMs with a single file.☆25,779Updated this week
- The official TypeScript SDK for Model Context Protocol servers and clients☆13,281Updated this week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆211Aug 3, 2026Updated 3 weeks ago
- Machine learning framework for Node.js.☆282Apr 19, 2025Updated last year
- Embeddable Postgres with real-time, reactive bindings.☆15,938Updated this week
- A fast, efficient Node.js Worker Thread Pool implementation☆5,199Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Port of OpenAI's Whisper model in C/C++☆53,298Updated this week
- Build ultra fast, tiny, and cross-platform desktop apps with Typescript.☆12,730Updated this week
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆48,766Updated this week
- Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆179,785Updated this week
- Web framework built on Web Standards☆32,029Updated this week
- Node.js binding of llama.cpp☆20Updated this week
- Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one☆95,808Updated this week
- ⚓ A collection of high-performance JavaScript tools.☆22,563Updated this week
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆443Aug 16, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Python bindings for llama.cpp☆10,594Aug 17, 2026Updated last week
- ⚡️ TypeScript Execute | The easiest way to run TypeScript in Node.js☆12,123Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.☆75,251Updated this week
- BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL☆9,348Updated this week
- LLama.cpp rust bindings☆424Jun 27, 2024Updated 2 years ago
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆11,313Updated this week
- Shared data types for building collaborative software☆22,722Aug 6, 2026Updated 3 weeks ago