Alternatives and similar repositories for node-llama-cpp

Users that are interested in node-llama-cpp are comparing it to the libraries listed below

• Atome-FE / llama-node
  Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…
  ☆872Updated last year
• ollama / ollama-js
  Ollama JavaScript library
  ☆3,471Updated 3 weeks ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆750Updated 2 weeks ago
• vercel / modelfusion
  The TypeScript library for building AI applications.
  ☆1,280Updated 11 months ago
• lmstudio-ai / lmstudio-js
  LM Studio TypeScript SDK
  ☆1,190Updated this week
• eduardoleao052 / js-pytorch
  A JavaScript library like PyTorch, with GPU acceleration.
  ☆1,175Updated 7 months ago
• ChetanXpro / nodejs-whisper
  NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.
  ☆146Updated last week
• withcatai / catai
  Run AI ✨ assistant locally! with simple API for Node.js 🚀
  ☆475Updated last year
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆492Updated last month
• frost-beta / node-mlx
  Machine learning framework for Node.js.
  ☆258Updated 2 months ago
• run-llama / LlamaIndexTS
  Data framework for your LLM applications. Focus on server side solution
  ☆2,701Updated this week
• nomic-ai / gpt4all-ts
  gpt4all and llama typescript bindings
  ☆397Updated last year
• tinylibs / tinypool
  🧵 A minimal and tiny Node.js Worker Thread Pool implementation (38KB)
  ☆1,452Updated last week
• qdrant / qdrant-js
  JavaScript/Typescript SDK for Qdrant Vector Database
  ☆342Updated last week
• piscinajs / piscina
  A fast, efficient Node.js Worker Thread Pool implementation
  ☆4,790Updated this week
• MatthewWid / better-sse
  ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript.
  ☆694Updated 2 weeks ago
• andywer / threads.js
  🧵 Make web workers & worker threads as simple as a function call.
  ☆3,473Updated last year
• huggingface / transformers.js
  State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
  ☆13,894Updated this week
• dqbd / tiktoken
  JS port and JS/WASM bindings for openai/tiktoken
  ☆882Updated 2 months ago
• dimdenGD / ultimate-express
  The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.
  ☆814Updated last week
• abi / secret-llama
  Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
  ☆2,624Updated last year
• anthropics / anthropic-sdk-typescript
  Access to Anthropic's safety-first language model APIs
  ☆1,069Updated this week
• Level / level
  Universal abstract-level database for Node.js and browsers.
  ☆1,640Updated last month
• Sandpack / nodebox-runtime
  Nodebox is a runtime for executing Node.js modules in the browser.
  ☆810Updated last year
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆976Updated last year
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆128Updated 2 months ago
• apocas / dockerode-compose
  docker-compose in Node.js using dockerode
  ☆157Updated 5 months ago
• 567-labs / instructor-js
  structured extraction for llms
  ☆723Updated 4 months ago
• kartikk221 / hyper-express
  High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.
  ☆1,937Updated 6 months ago
• privatenumber / pkgroll
  📦 Zero-config package bundler for Node.js + TypeScript
  ☆1,447Updated last week