WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆1,363Nov 6, 2026Updated this week
Alternatives and similar repositories for wllama
Users that are interested in wllama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆293Jul 23, 2024Updated 2 years ago
- High-performance In-browser LLM Inference Engine☆19,356Updated this week
- A cross-platform browser ML framework.☆771Sep 24, 2026Updated last month
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆2,200Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,403Oct 30, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Distribute and run LLMs with a single file.☆26,576Updated this week
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,689Updated this week
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,076Sep 20, 2023Updated 3 years ago
- A vector search SQLite extension that runs anywhere!☆8,240May 18, 2026Updated 5 months ago
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆7,917Updated this week
- Fast, flexible LLM inference☆7,815Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆869Nov 16, 2024Updated last year
- Tensor library for machine learning☆15,586Updated this week
- LLM inference in C/C++☆133,556Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆940Oct 27, 2026Updated last week
- Local AI API Platform☆2,747Jul 4, 2025Updated last year
- Thin wrapper around GGML to make life easier☆49Jul 26, 2026Updated 3 months ago
- 🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers☆59Oct 14, 2026Updated 3 weeks ago
- Embeddable Postgres with real-time, reactive bindings.☆16,243Updated this week
- High-level, optionally asynchronous Rust bindings to llama.cpp☆251Jun 5, 2024Updated 2 years ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,377Updated this week
- Minimalist ML framework for Rust☆21,279Updated this week
- Universal LLM Deployment Engine with ML Compilation☆23,308Oct 30, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Python bindings for llama.cpp☆10,668Oct 1, 2026Updated last month
- Structured Outputs☆16,005Sep 21, 2026Updated last month
- Port of OpenAI's Whisper model in C/C++☆54,976Updated this week
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space☆608Updated this week
- CI for ggml and related projects☆30Mar 8, 2026Updated 7 months ago
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,663Feb 8, 2026Updated 8 months ago
- VS Code extension for LLM-assisted code/text completion☆1,551Updated this week
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆3,131Updated this week
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,590Mar 23, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,063Updated this week
- Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don…☆6,180Updated this week
- llama.cpp's official website☆21Updated this week
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆50,229Updated this week
- Vercel and web-llm template to run wasm models directly in the browser.☆180Apr 17, 2026Updated 6 months ago
- A collection of 🤗 Transformers.js demos and example applications☆2,116Feb 17, 2026Updated 8 months ago
- 2bit quants, kernels and runtime for consumer devices.☆6,183Updated this week