cztomsik / ava
All-in-one desktop app for running LLMs locally.
β443Updated last week
Alternatives and similar repositories for ava:
Users that are interested in ava are comparing it to the libraries listed below
- Replace OpenAI with Llama.cpp Automagically.β314Updated 10 months ago
- From anywhere you can type, query and stream the output of an LLM or any other scriptβ494Updated last year
- Stateful load balancer custom-tailored for llama.cpp ππ¦β742Updated 2 weeks ago
- GUI for selecting text files for concatenation and submission to LLMsβ163Updated this week
- MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agentβ561Updated last year
- An AI assistant beyond the chat box.β325Updated last year
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.β377Updated last year
- A SQLite extension for generating text embeddings from GGUF models using llama.cppβ179Updated 4 months ago
- Chat with your documents using local AIβ1,027Updated 9 months ago
- Native gui to serveral AI services plus llama.cpp local AIs.β114Updated last year
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkitβ762Updated 8 months ago
- An open-source alternative to GitHub copilot that runs locally.β958Updated 11 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.β579Updated 5 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.β181Updated 2 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.β398Updated 3 months ago
- an app to seamlessly interact with your llm.β93Updated last year
- Finetune llama2-70b and codellama on MacBook Air without quantizationβ448Updated last year
- Visual inference exploration & experimentation playgroundβ90Updated 4 months ago
- (Cross-Platform) An open source approach to locally record and enable searching everything you view on any computer.β274Updated 11 months ago
- β163Updated 10 months ago
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: httpsβ¦β391Updated this week
- Open source alternative to Perplexity AI with ability to run locallyβ199Updated 6 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient β¦β220Updated 4 months ago
- Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.β280Updated last year
- An implementation of bucketMul LLM inferenceβ216Updated 9 months ago
- LLM Frontend in a single html fileβ447Updated 3 months ago
- Hyper-minimal low-latency webserver for serving SPAs and static content based on fasthttp.β234Updated 10 months ago
- This project provides an API with user level access support to transcribe speech to text using a finetuned and processed Whisper ASR modeβ¦β886Updated last year
- ChatGPT UI that is keyboard-centric, mobile friendly, and searchable.β185Updated 3 weeks ago
- LLM plugin for running models using MLCβ185Updated last year