ngxson / wllamaView external linksLinks
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆993Dec 17, 2025Updated last month
Alternatives and similar repositories for wllama
Users that are interested in wllama are comparing it to the libraries listed below
Sorting:
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆285Jul 23, 2024Updated last year
- A cross-platform browser ML framework.☆746Nov 23, 2024Updated last year
- High-performance In-browser LLM Inference Engine☆17,258Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,352Updated this week
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆1,867Jan 26, 2026Updated 2 weeks ago
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆798Feb 4, 2026Updated last week
- High-level, optionally asynchronous Rust bindings to llama.cpp☆242Jun 5, 2024Updated last year
- Local AI API Platform☆2,762Jul 4, 2025Updated 7 months ago
- Distribute and run LLMs with a single file.☆23,704Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆855Nov 16, 2024Updated last year
- Fast, flexible LLM inference☆6,508Updated this week
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆5,372Updated this week
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆540Feb 7, 2026Updated last week
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,822Feb 4, 2026Updated last week
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,562Mar 23, 2025Updated 10 months ago
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆51Jul 30, 2024Updated last year
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆438Dec 1, 2025Updated 2 months ago
- Tensor library for machine learning☆13,923Feb 7, 2026Updated last week
- A vector search SQLite extension that runs anywhere!☆6,858Jan 24, 2025Updated last year
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,591Updated this week
- ☆16Aug 16, 2025Updated 5 months ago
- Vercel and web-llm template to run wasm models directly in the browser.☆169Nov 21, 2023Updated 2 years ago
- Universal LLM Deployment Engine with ML Compilation☆22,012Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,129Updated this week
- Python bindings for llama.cpp☆9,971Aug 15, 2025Updated 5 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,440Dec 9, 2025Updated 2 months ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,047Sep 20, 2023Updated 2 years ago
- GGUF implementation in C as a library and a tools CLI program☆303Aug 28, 2025Updated 5 months ago
- LLM inference in C/C++☆94,823Updated this week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,374Updated this week
- Code for Papeg.ai☆227Jan 5, 2025Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙 Alternative to projects like llm-d, Docker Model R…☆1,447Feb 6, 2026Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆1,605Updated this week
- LLM-powered lossless compression tool☆303Jan 2, 2026Updated last month
- ☆134Dec 11, 2025Updated 2 months ago
- Web UI for ExLlamaV2☆513Feb 5, 2025Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆193Aug 20, 2024Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆614Feb 17, 2025Updated 11 months ago
- Large-scale LLM inference engine☆1,647Jan 21, 2026Updated 3 weeks ago