vince-lam / awesome-local-llms
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆562Updated this week
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,534Updated 6 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆589Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆562Updated 2 months ago
- Efficient visual programming for AI language models☆361Updated 8 months ago
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆463Updated 4 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆730Updated 3 weeks ago
- Large-scale LLM inference engine☆1,419Updated this week
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆382Updated 3 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆677Updated last month
- a self-hosted webui for 30+ generative ai☆578Updated this week
- AI Studio is an independent app for utilizing LLM.☆259Updated last week
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆400Updated 4 months ago
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆642Updated 9 months ago
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆283Updated 2 months ago
- Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and Comf…☆450Updated 2 weeks ago
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆745Updated this week
- LLMX; Easiest 3rd party Local LLM UI for the web!☆242Updated last week
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆313Updated 2 months ago
- A proxy server for multiple ollama instances with Key security☆421Updated last month
- Web UI for ExLlamaV2☆496Updated 3 months ago
- Replace OpenAI with Llama.cpp Automagically.☆318Updated 11 months ago
- Minimalistic UI for Ollama LMs - This powerful react interface for LLMs drastically improves the chatbot experience and works offline.☆318Updated 7 months ago
- A collection of standardized JSON descriptors for Large Language Model (LLM) files.☆797Updated 9 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆318Updated 7 months ago
- Go manage your Ollama models☆1,076Updated last week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆362Updated last week
- ☆202Updated 3 weeks ago
- An AI assistant beyond the chat box.☆328Updated last year
- function calling-based LLM agents☆285Updated 7 months ago
- Local AI API Platform☆2,655Updated last week