cztomsik / ava
All-in-one desktop app for running LLMs locally.
☆442Updated 4 months ago
Alternatives and similar repositories for ava:
Users that are interested in ava are comparing it to the libraries listed below
- Replace OpenAI with Llama.cpp Automagically.☆308Updated 8 months ago
- The easiest way to run the fastest MLX-based LLMs locally☆257Updated 4 months ago
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs☆158Updated last month
- From anywhere you can type, query and stream the output of an LLM or any other script☆483Updated 10 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆713Updated last month
- A SQLite extension for generating text embeddings from GGUF models using llama.cpp☆172Updated 3 months ago
- An extremely fast implementation of whisper optimized for Apple Silicon using MLX.☆656Updated 9 months ago
- An open-source VSCode extension, the AI coding assistant, integrates with Ollama, HuggingFace, OpenAI, and Anthropic.☆189Updated last week
- llama.cpp based AI chat app for macOS☆464Updated 3 months ago
- Tensor library for machine learning☆278Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆604Updated this week
- Build AI products faster. A language-agnostic microservices platform for building AI applications.☆183Updated this week
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆180Updated last month
- An implementation of bucketMul LLM inference☆215Updated 8 months ago
- Web UI for ExLlamaV2☆484Updated 3 weeks ago
- Compile binaries for macOS on Linux☆368Updated 2 months ago
- LLM-powered lossless compression tool☆271Updated 6 months ago
- A very simple tool to build LLM prompts from your code repositories.☆150Updated 2 weeks ago
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit☆749Updated 6 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆392Updated last month
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆658Updated last month
- Mac compatible Ollama Voice☆462Updated 11 months ago
- Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tool…☆529Updated last month
- Create Linux commands from natural language, in the shell.☆108Updated 4 months ago
- ChatGPT UI that is keyboard-centric, mobile friendly, and searchable.☆180Updated this week
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆218Updated 2 months ago
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆364Updated this week
- Visual inference exploration & experimentation playground☆88Updated 3 months ago
- FastMLX is a high performance production ready API to host MLX models.☆265Updated 3 months ago