cztomsik / ava
All-in-one desktop app for running LLMs locally.
β437Updated 2 months ago
Alternatives and similar repositories for ava:
Users that are interested in ava are comparing it to the libraries listed below
- Replace OpenAI with Llama.cpp Automagically.β301Updated 7 months ago
- From anywhere you can type, query and stream the output of an LLM or any other scriptβ482Updated 9 months ago
- Stateful load balancer custom-tailored for llama.cpp ππ¦β676Updated last week
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.β379Updated 10 months ago
- ai for jqβ236Updated 4 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient β¦β216Updated last month
- Run any ML model from any programming language.β422Updated last year
- An AI assistant beyond the chat box.β317Updated 10 months ago
- A SQLite extension for generating text embeddings from GGUF models using llama.cppβ155Updated 2 months ago
- Visual inference exploration & experimentation playgroundβ85Updated 2 months ago
- transparent proxy server for llama.cpp's server to provide automatic model swappingβ150Updated last week
- 𧬠Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-classβ¦β388Updated this week
- β163Updated 8 months ago
- GUI for selecting text files for concatenation and submission to LLMsβ134Updated 2 months ago
- Client Side Vector Databaseβ261Updated 6 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.β176Updated 2 weeks ago
- VS Code extension for local LLM-assisted code/text completionβ394Updated this week
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMsβ134Updated last month
- The code repository from plang programming languageβ55Updated this week
- An extremely fast implementation of whisper optimized for Apple Silicon using MLX.β627Updated 8 months ago
- β175Updated 3 months ago
- β126Updated 3 weeks ago
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Frameworkβ337Updated 2 months ago
- Attempt to create an Open Source Privacy Focused Rewind.ai Alternative for data captureβ194Updated last week
- Web-optimized vector database (written in Rust).β200Updated 2 weeks ago
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.β273Updated 3 weeks ago
- An open-source VSCode extension, the AI coding assistant, integrates with Ollama, HuggingFace, OpenAI, and Anthropic.β172Updated this week
- Web UI for ExLlamaV2β468Updated this week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inferenceβ523Updated this week