tangledgroup / llama-cpp-wasm

Related projects ⓘ

Alternatives and complementary repositories for llama-cpp-wasm

• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
  ☆441Updated 3 weeks ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆124Updated last year
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆167Updated 2 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆131Updated 4 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆233Updated 2 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆93Updated this week
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆91Updated 3 months ago
• kortix-ai / fast-apply
  ☆102Updated last week
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆30Updated 4 months ago
• nitaiaharoni1 / vector-storage
  Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…
  ☆201Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆147Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆343Updated 4 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆170Updated 5 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated 6 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆625Updated this week
• cognitivecomputations / OpenChatML
  ☆149Updated 4 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆63Updated 11 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆175Updated last year
• e2b-dev / infra
  Infrastructure for AI code interpreting that's powering E2B.
  ☆221Updated this week
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆208Updated last month
• sam-paech / antislop-sampler
  ☆228Updated last month
• not-pizza / victor
  Web-optimized vector database (written in Rust).
  ☆189Updated 4 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆79Updated 7 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆252Updated 3 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆219Updated this week
• cjpais / whisperfile
  ☆53Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆149Updated 4 months ago
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆53Updated last year