Alternatives and similar repositories for node-llama-cpp

Users that are interested in node-llama-cpp are comparing it to the libraries listed below

• Atome-FE / llama-node
  Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…
  ☆869Updated 2 years ago
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆575Updated last week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆987Updated last month
• lmstudio-ai / lmstudio-js
  LM Studio TypeScript SDK
  ☆1,469Updated this week
• ollama / ollama-js
  Ollama JavaScript library
  ☆3,935Updated last week
• vercel / modelfusion
  The TypeScript library for building AI applications.
  ☆1,307Updated last year
• withcatai / catai
  Run AI ✨ assistant locally! with simple API for Node.js 🚀
  ☆481Updated 2 months ago
• qdrant / qdrant-js
  JavaScript/Typescript SDK for Qdrant Vector Database
  ☆417Updated 2 months ago
• run-llama / LlamaIndexTS
  Data framework for your LLM applications. Focus on server side solution
  ☆3,026Updated last week
• eduardoleao052 / js-pytorch
  A JavaScript library like PyTorch, with GPU acceleration.
  ☆1,223Updated last year
• ChetanXpro / nodejs-whisper
  NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.
  ☆194Updated last month
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆1,046Updated 2 years ago
• ariym / whisper-node
  Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)
  ☆295Updated last year
• dqbd / tiktoken
  JS port and JS/WASM bindings for openai/tiktoken
  ☆1,007Updated 5 months ago
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,761Updated 6 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆285Updated last year
• ewfian / faiss-node
  Node.js bindings for faiss
  ☆138Updated 2 years ago
• josdejong / workerpool
  Offload tasks to a pool of workers on node.js and in the browser
  ☆2,282Updated last week
• nomic-ai / gpt4all-ts
  gpt4all and llama typescript bindings
  ☆397Updated last year
• dimdenGD / ultimate-express
  The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.
  ☆1,037Updated last week
• niieani / gpt-tokenizer
  The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…
  ☆729Updated last month
• huggingface / huggingface.js
  Use Hugging Face with JavaScript
  ☆2,333Updated last week
• yao-pkg / pkg
  Package your Node.js project into an executable
  ☆825Updated this week
• postalsys / imapflow
  IMAP Client library for EmailEngine Email API (https://emailengine.app)
  ☆496Updated this week
• MatthewWid / better-sse
  ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript
  ☆799Updated last month
• kartikk221 / hyper-express
  High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.
  ☆2,017Updated last year
• piscinajs / piscina
  A fast, efficient Node.js Worker Thread Pool implementation
  ☆5,026Updated last week
• breejs / bree
  Bree is a Node.js and JavaScript job task scheduler with worker threads, cron, Date, and human syntax. Built for @ladjs, @forwardemail, @…
  ☆3,263Updated 2 weeks ago
• 567-labs / instructor-js
  structured extraction for llms
  ☆765Updated last year
• anthropics / anthropic-sdk-typescript
  Access to Anthropic's safety-first language model APIs in TypeScript
  ☆1,546Updated this week