Alternatives and similar repositories for llama-cpp-wasm

Users that are interested in llama-cpp-wasm are comparing it to the libraries listed below

• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆209Updated 9 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆750Updated 2 weeks ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆152Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆137Updated 11 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆702Updated 7 months ago
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆110Updated 3 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated 2 years ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆353Updated 11 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆33Updated last month
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆178Updated last month
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆249Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆285Updated 10 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆186Updated 10 months ago
• keithwhor / wavtools
  Record and stream WAV audio data in the browser across all platforms
  ☆83Updated 7 months ago
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆43Updated 3 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• RealSput / Wenode
  WebContainers, except it's a million times easier to use
  ☆83Updated 2 years ago
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆128Updated 2 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆312Updated last year
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆128Updated 10 months ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆322Updated last week
• PaulKinlan / idb-vector
  A simple vector database built on idb
  ☆90Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆209Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆194Updated 5 months ago
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆135Updated 8 months ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆276Updated 2 years ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆493Updated last year