Alternatives and similar repositories for node-llama-cpp:

Users that are interested in node-llama-cpp are comparing it to the libraries listed below

• Atome-FE / llama-node
  Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…
  ☆869Updated last year
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆453Updated 4 months ago
• ollama / ollama-js
  Ollama JavaScript library
  ☆3,179Updated 3 weeks ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆246Updated 8 months ago
• withcatai / catai
  Run AI ✨ assistant locally! with simple API for Node.js 🚀
  ☆471Updated 9 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆620Updated last week
• ariym / whisper-node
  Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)
  ☆262Updated 7 months ago
• qdrant / qdrant-js
  JavaScript/Typescript SDK for Qdrant Vector Database
  ☆304Updated this week
• lmstudio-ai / lmstudio-js
  LM Studio TypeScript SDK
  ☆922Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,563Updated this week
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆934Updated last year
• ChetanXpro / nodejs-whisper
  NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.
  ☆119Updated this week
• run-llama / LlamaIndexTS
  Data framework for your LLM applications. Focus on server side solution
  ☆2,431Updated this week
• vercel / modelfusion
  The TypeScript library for building AI applications.
  ☆1,236Updated 8 months ago
• llm-tools / embedJs
  A NodeJS RAG framework to easily work with LLMs and embeddings
  ☆466Updated last month
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆188Updated 6 months ago
• ollama-interface / Ollama-Gui
  A GUI interface for Ollama
  ☆323Updated 5 months ago
• nomic-ai / gpt4all-ts
  gpt4all and llama typescript bindings
  ☆396Updated last year
• dqbd / tiktoken
  JS port and JS/WASM bindings for openai/tiktoken
  ☆814Updated last month
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆263Updated 3 months ago
• PABannier / bark.cpp
  Suno AI's Bark model in C/C++ for fast text-to-speech generation
  ☆785Updated 4 months ago
• lmstudio-ai / model-catalog
  A collection of standardized JSON descriptors for Large Language Model (LLM) files.
  ☆794Updated 7 months ago
• kartikk221 / hyper-express
  High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.
  ☆1,893Updated 3 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆191Updated 9 months ago
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,532Updated this week
• instructor-ai / instructor-js
  structured extraction for llms
  ☆691Updated last month
• postalsys / imapflow
  IMAP Client library for EmailEngine Email API (https://emailengine.app)
  ☆408Updated last week
• breejs / bree
  Bree is a Node.js and JavaScript job task scheduler with worker threads, cron, Date, and human syntax. Built for @ladjs, @forwardemail, @…
  ☆3,128Updated this week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆311Updated 9 months ago
• langchain-ai / chat-langchainjs
  💬 Chat with the LangChain JS/TS documentation, with sources. 💬
  ☆308Updated 7 months ago