Alternatives and similar repositories for llama-cpp-wasm:

Users that are interested in llama-cpp-wasm are comparing it to the libraries listed below

• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆635Updated 2 weeks ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆144Updated last year
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆189Updated 6 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 8 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆224Updated last week
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆105Updated 2 weeks ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆105Updated 7 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆669Updated 4 months ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆351Updated 9 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆181Updated 2 months ago
• xenova / kokoro-web
  ML-powered speech synthesis directly in your browser
  ☆137Updated last month
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆53Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆191Updated 9 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 6 months ago
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆74Updated this week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆173Updated 6 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆53Updated 11 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 5 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆174Updated 8 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆274Updated 7 months ago
• pdufour / llm-coder
  In-browser LLM website generator
  ☆46Updated last month
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆33Updated 8 months ago
• lucasgelfond / webgpu-sam2
  Segment Anything 2, 100% in the browser (with WebGPU!)
  ☆123Updated 3 months ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆138Updated 2 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆147Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated 11 months ago