Alternatives and similar repositories for llama-cpp-wasm:

Users that are interested in llama-cpp-wasm are comparing it to the libraries listed below

• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆582Updated last week
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆134Updated 7 months ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆137Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆658Updated 2 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆180Updated 5 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆184Updated 9 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆148Updated last year
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆103Updated 6 months ago
• nitaiaharoni1 / vector-storage
  Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…
  ☆214Updated 2 months ago
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆54Updated last year
• fardjad / node-llmatic
  Use self-hosted LLMs with an OpenAI compatible API
  ☆63Updated 10 months ago
• mithril-security / blind_chat
  A fully in-browser privacy solution to make Conversational AI privacy-friendly
  ☆227Updated 4 months ago
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆72Updated 7 months ago
• themaximalist / llm.js
  Simple LLM library for JavaScript
  ☆38Updated 3 weeks ago
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆113Updated last month
• not-pizza / victor
  Web-optimized vector database (written in Rust).
  ☆208Updated last week
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆349Updated 7 months ago
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆436Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆163Updated 7 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆185Updated 8 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆179Updated 3 weeks ago
• glaive-ai / function-calling-server
  ☆35Updated last year
• mlc-ai / binary-mlc-llm-libs
  ☆228Updated 3 months ago
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆155Updated this week
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆55Updated 10 months ago
• e2b-dev / infra
  Infrastructure for AI code interpreting that's powering E2B.
  ☆289Updated this week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 4 months ago