WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆1,054May 4, 2026Updated this week
Alternatives and similar repositories for wllama
Users that are interested in wllama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆290Jul 23, 2024Updated last year
- A cross-platform browser ML framework.☆757Apr 2, 2026Updated last month
- High-performance In-browser LLM Inference Engine☆17,858Apr 24, 2026Updated last week
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆2,038Apr 28, 2026Updated last week
- High-level, optionally asynchronous Rust bindings to llama.cpp☆245Jun 5, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,950Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆859Nov 16, 2024Updated last year
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆562Updated this week
- Distribute and run LLMs with a single file.☆24,349Updated this week
- Local AI API Platform☆2,760Jul 4, 2025Updated 10 months ago
- Fast, flexible LLM inference☆7,103Apr 15, 2026Updated 3 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,059Sep 20, 2023Updated 2 years ago
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆16Mar 6, 2026Updated 2 months ago
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆5,894Apr 29, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆872Apr 3, 2026Updated last month
- CI for ggml and related projects☆32Mar 8, 2026Updated last month
- A vector search SQLite extension that runs anywhere!☆7,520Apr 8, 2026Updated 3 weeks ago
- Tensor library for machine learning☆14,560Apr 29, 2026Updated last week
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,917Apr 14, 2026Updated 3 weeks ago
- Vercel and web-llm template to run wasm models directly in the browser.☆173Apr 17, 2026Updated 2 weeks ago
- LLM inference in C/C++☆107,892Updated this week
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,547Updated this week
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆52Jul 30, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,569Mar 23, 2025Updated last year
- Universal LLM Deployment Engine with ML Compilation☆22,557Apr 22, 2026Updated 2 weeks ago
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,626Feb 8, 2026Updated 2 months ago
- Code for Papeg.ai☆227Jan 5, 2025Updated last year
- Python bindings for llama.cpp☆10,264Updated this week
- ☆16Feb 21, 2026Updated 2 months ago
- GGUF implementation in C as a library and a tools CLI program☆312Aug 28, 2025Updated 8 months ago
- LLama.cpp rust bindings☆422Jun 27, 2024Updated last year
- Web browser version of StarCoder.cpp☆46Jul 30, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple library for working with Hugging Face models.☆14Dec 30, 2024Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆3,772Updated this week
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆1,014Feb 18, 2026Updated 2 months ago
- ☆136Apr 8, 2026Updated 3 weeks ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,205Updated this week