vince-lam / awesome-local-llmsLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆591Updated last month
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,575Updated 7 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆573Updated 4 months ago
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,880Updated this week
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆669Updated 10 months ago
- Efficient visual programming for AI language models☆364Updated last month
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆317Updated 3 months ago
- AI Studio is an independent app for utilizing LLMs.☆280Updated this week
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆765Updated 2 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆597Updated 7 months ago
- A collection of standardized JSON descriptors for Large Language Model (LLM) files.☆798Updated 10 months ago
- Querying local documents, powered by LLM☆606Updated 3 weeks ago
- LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for …☆810Updated last week
- Go manage your Ollama models☆1,183Updated last week
- Web UI for ExLlamaV2☆502Updated 4 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆705Updated last week
- LLMX; Easiest 3rd party Local LLM UI for the web!☆255Updated last month
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆488Updated this week
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆744Updated 3 months ago
- a self-hosted webui for 30+ generative ai☆593Updated this week
- Plugin that lets you ask questions about your documents including audio and video files.☆340Updated last week
- A collection of open source, actively maintained web apps for LLM applications☆597Updated last year
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆782Updated 4 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆382Updated last month
- a Repository of Open-WebUI tools to use with your favourite LLMs☆232Updated last week
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆320Updated 9 months ago
- Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and Comf…☆484Updated last month
- Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.☆1,057Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆990Updated this week
- A multimodal, function calling powered LLM webui.☆214Updated 9 months ago