ngxson / wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
☆653Updated last month
Alternatives and similar repositories for wllama:
Users that are interested in wllama are comparing it to the libraries listed below
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆249Updated 8 months ago
- A cross-platform browser ML framework.☆683Updated 4 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆737Updated last week
- VS Code extension for LLM-assisted code/text completion☆656Updated 3 weeks ago
- FastMLX is a high performance production ready API to host MLX models.☆288Updated 3 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆944Updated last year
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,662Updated last week
- Apple MLX engine for LM Studio☆506Updated this week
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆301Updated last week
- Replace OpenAI with Llama.cpp Automagically.☆313Updated 10 months ago
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆435Updated 2 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆551Updated 2 months ago
- Big & Small LLMs working together☆686Updated this week
- Gemma 2 optimized for your local machine.☆367Updated 8 months ago
- Vercel and web-llm template to run wasm models directly in the browser.☆146Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆262Updated this week
- Minimal LLM inference in Rust☆985Updated 5 months ago
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆1,155Updated this week
- A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…☆197Updated 10 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆577Updated 5 months ago
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,342Updated this week
- Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,019Updated this week
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆570Updated this week
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆796Updated 5 months ago
- Local AI API Platform☆2,615Updated this week
- E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.☆587Updated this week
- EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly☆146Updated 3 months ago
- An extremely fast implementation of whisper optimized for Apple Silicon using MLX.☆686Updated 11 months ago
- Qwen 2.5 Coder 1.5B with Code Interpreter☆280Updated 5 months ago
- SemanticFinder - frontend-only live semantic search with transformers.js☆268Updated 2 weeks ago