vince-lam / awesome-local-llms
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆527Updated 2 months ago
Alternatives and similar repositories for awesome-local-llms:
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
- An awesome repository of local AI tools☆1,465Updated 4 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆676Updated 2 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆626Updated this week
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆423Updated 2 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆569Updated 4 months ago
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆520Updated 2 months ago
- Replace OpenAI with Llama.cpp Automagically.☆311Updated 9 months ago
- Efficient visual programming for AI language models☆353Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆547Updated last month
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆396Updated 2 months ago
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,483Updated this week
- a text-based terminal client for Ollama☆1,460Updated this week
- An OAI compatible exllamav2 API that's both lightweight and fast☆873Updated this week
- Web UI for ExLlamaV2☆486Updated last month
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆346Updated 3 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆305Updated 3 weeks ago
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆275Updated last month
- Plugin that lets you ask questions about your documents including audio and video files.☆329Updated this week
- 100% Local AGI with LocalAI☆451Updated 9 months ago
- Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and Comf…☆338Updated 2 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆318Updated 6 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆245Updated last month
- Pipelines: Versatile, UI-Agnostic OpenAI-Compatible Plugin Framework☆1,594Updated last week
- Your Local Artificial Memory on your Device.☆473Updated 3 months ago
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆729Updated 3 weeks ago
- An AI assistant beyond the chat box.☆322Updated last year
- Large-scale LLM inference engine☆1,355Updated last week
- We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 …☆839Updated 8 months ago
- Local AI API Platform☆2,579Updated this week
- Big & Small LLMs working together☆521Updated this week