WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆1,009Dec 17, 2025Updated 2 months ago
Alternatives and similar repositories for wllama
Users that are interested in wllama are comparing it to the libraries listed below
Sorting:
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆285Jul 23, 2024Updated last year
- High-performance In-browser LLM Inference Engine☆17,456Feb 18, 2026Updated 2 weeks ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,477Updated this week
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆1,917Updated this week
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆821Feb 23, 2026Updated last week
- Local AI API Platform☆2,759Jul 4, 2025Updated 8 months ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆243Jun 5, 2024Updated last year
- Distribute and run LLMs with a single file.☆23,755Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆857Nov 16, 2024Updated last year
- Fast, flexible LLM inference☆6,653Feb 27, 2026Updated last week
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆5,490Updated this week
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆547Updated this week
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,842Feb 10, 2026Updated 3 weeks ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,564Mar 23, 2025Updated 11 months ago
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆51Jul 30, 2024Updated last year
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆445Dec 1, 2025Updated 3 months ago
- Tensor library for machine learning☆14,152Feb 27, 2026Updated last week
- A vector search SQLite extension that runs anywhere!☆7,041Feb 13, 2026Updated 3 weeks ago
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,604Feb 8, 2026Updated 3 weeks ago
- ☆16Feb 21, 2026Updated last week
- Vercel and web-llm template to run wasm models directly in the browser.☆169Nov 21, 2023Updated 2 years ago
- Universal LLM Deployment Engine with ML Compilation☆22,082Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,139Feb 9, 2026Updated 3 weeks ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,444Dec 9, 2025Updated 2 months ago
- Python bindings for llama.cpp☆10,020Aug 15, 2025Updated 6 months ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,052Sep 20, 2023Updated 2 years ago
- GGUF implementation in C as a library and a tools CLI program☆310Aug 28, 2025Updated 6 months ago
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙 Alternative to projects like llm-d, Docker Model R…☆1,474Updated this week
- LLM inference in C/C++☆96,322Updated this week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,506Updated this week
- Code for Papeg.ai☆228Jan 5, 2025Updated last year
- llama.cpp fork with additional SOTA quants and improved performance☆1,696Updated this week
- LLM-powered lossless compression tool☆305Jan 2, 2026Updated 2 months ago
- ☆134Feb 28, 2026Updated last week
- Web UI for ExLlamaV2☆512Feb 5, 2025Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆193Aug 20, 2024Updated last year
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆35Feb 11, 2026Updated 3 weeks ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆619Feb 17, 2025Updated last year
- Large-scale LLM inference engine☆1,666Updated this week