vince-lam / awesome-local-llmsLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆705Updated 2 months ago
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,813Updated last year
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆628Updated last year
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆548Updated 7 months ago
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆608Updated 6 months ago
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆730Updated last year
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆799Updated 3 weeks ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆903Updated 2 months ago
- AI Studio is an independent app for utilizing LLMs.☆379Updated this week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆612Updated 11 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆322Updated last year
- Efficient visual programming for AI language models☆361Updated 8 months ago
- LLMX; Easiest 3rd party Local LLM UI for the web!☆288Updated 2 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆345Updated 10 months ago
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆317Updated 5 months ago
- LLM Frontend in a single html file☆691Updated 3 weeks ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆435Updated last month
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆434Updated last year
- Web UI for ExLlamaV2☆514Updated 11 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆333Updated last month
- Code for Papeg.ai☆226Updated last year
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆676Updated last year
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 11 months ago
- An AI assistant beyond the chat box.☆329Updated last year
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆527Updated last month
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆367Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆267Updated 10 months ago
- Plugin that lets you ask questions about your documents including audio and video files.☆360Updated last month
- A collection of open source, actively maintained web apps for LLM applications☆695Updated 6 months ago
- Dolphin System Messages☆380Updated 11 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,115Updated this week