vince-lam / awesome-local-llmsLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆676Updated 2 weeks ago
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,742Updated last year
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆532Updated 5 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆621Updated last year
- a self-hosted webui for 30+ generative ai☆635Updated this week
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆714Updated last year
- AI Studio is an independent app for utilizing LLMs.☆320Updated last week
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆874Updated this week
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆312Updated 3 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆606Updated 9 months ago
- Efficient visual programming for AI language models☆363Updated 6 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆428Updated 10 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆342Updated 8 months ago
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆311Updated 3 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,090Updated this week
- Web UI for ExLlamaV2☆514Updated 9 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆323Updated last year
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆786Updated last month
- Too Long, Didn't Watch: End-to-End Rolling Summarizer of Long Videos☆353Updated 2 months ago
- Code for Papeg.ai☆227Updated 10 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆325Updated 8 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆414Updated last week
- LM Studio JSON configuration file format and a collection of example config files.☆205Updated last year
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆601Updated 4 months ago
- A collection of standardized JSON descriptors for Large Language Model (LLM) files.☆802Updated last year
- LLM prompts, llama3 prompts, llama2 prompts☆257Updated last year
- LLMX; Easiest 3rd party Local LLM UI for the web!☆280Updated 3 weeks ago
- 👀 What LLM to use?☆646Updated last year
- End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model manage…☆610Updated 3 weeks ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 8 months ago