ngxson / wllamaLinks
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆942Updated this week
Alternatives and similar repositories for wllama
Users that are interested in wllama are comparing it to the libraries listed below
Sorting:
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆284Updated last year
- A cross-platform browser ML framework.☆725Updated last year
- EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly☆254Updated 6 months ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,013Updated 2 years ago
- ☆509Updated this week
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,379Updated last week
- VS Code extension for LLM-assisted code/text completion☆1,072Updated 2 weeks ago
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆891Updated 3 months ago
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆221Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆611Updated 9 months ago
- Vercel and web-llm template to run wasm models directly in the browser.☆164Updated 2 years ago
- On-device LLM Inference Powered by X-Bit Quantization☆272Updated 2 weeks ago
- FastMLX is a high performance production ready API to host MLX models.☆332Updated 8 months ago
- Big & Small LLMs working together☆1,211Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆848Updated last year
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆749Updated this week
- LM Studio Apple MLX engine☆830Updated 2 weeks ago
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆1,887Updated this week
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,546Updated this week
- Local AI API Platform☆2,764Updated 4 months ago
- ML-powered speech synthesis directly in your browser☆169Updated 9 months ago
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆458Updated 10 months ago
- Run LLMs in the Browser with MLC / WebLLM ✨☆149Updated last year
- SemanticFinder - frontend-only live semantic search with transformers.js☆307Updated 8 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆620Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆141Updated last year
- LLM-powered lossless compression tool☆294Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆324Updated last year
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆603Updated last month
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 10 months ago