Alternatives and similar repositories for llama-cpp-wasm

Users that are interested in llama-cpp-wasm are comparing it to the libraries listed below

• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆970Updated 3 weeks ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆222Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆166Updated 2 years ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆141Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆317Updated 9 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆107Updated 2 years ago
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆117Updated 5 months ago
• mithril-security / blind_chat
  A fully in-browser privacy solution to make Conversational AI privacy-friendly
  ☆233Updated last year
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆261Updated 8 months ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆362Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆224Updated last year
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆556Updated 7 months ago
• not-pizza / victor
  Web-optimized vector database (written in Rust).
  ☆259Updated 10 months ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆158Updated last year
• praeclarum / transformers-js
  Browser-compatible JS library for running language models
  ☆232Updated 3 years ago
• Anush008 / fastembed-js
  Generate vector embeddings in NodeJS
  ☆170Updated 3 weeks ago
• nitaiaharoni1 / vector-storage
  Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…
  ☆242Updated last year
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆274Updated 2 years ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆739Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆45Updated 2 months ago
• themaximalist / llm.js
  Universal LLM Interface
  ☆128Updated 2 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆51Updated last year
• keithwhor / wavtools
  Record and stream WAV audio data in the browser across all platforms
  ☆91Updated last year
• token-js / token.js
  Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.
  ☆300Updated 8 months ago
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆150Updated last year
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆274Updated this week
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆74Updated last year
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆35Updated 7 months ago