vince-lam / awesome-local-llmsLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆651Updated last week
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,676Updated 10 months ago
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆523Updated 3 months ago
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆596Updated 2 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆607Updated 10 months ago
- Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and Comfy…☆544Updated 4 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆406Updated 4 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆768Updated this week
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆515Updated 6 months ago
- Efficient visual programming for AI language models☆362Updated 4 months ago
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆308Updated 3 weeks ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆834Updated 5 months ago
- AI Studio is an independent app for utilizing LLMs.☆302Updated 2 weeks ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆337Updated 6 months ago
- a self-hosted webui for 30+ generative ai☆615Updated this week
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆322Updated 11 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆360Updated 10 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆421Updated 8 months ago
- LLMX; Easiest 3rd party Local LLM UI for the web!☆272Updated 2 weeks ago
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆696Updated last year
- Code for Papeg.ai☆224Updated 8 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆589Updated 7 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 6 months ago
- Too Long, Didn't Watch: End-to-End Rolling Summarizer of Long Videos☆343Updated 2 weeks ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 7 months ago
- List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search☆1,037Updated this week
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆294Updated last month
- An AI assistant beyond the chat box.☆329Updated last year
- A command-line personal assistant that integrates with Google Calendar, Gmail, and Tasks to help manage your digital life.☆126Updated 10 months ago
- plug whisper audio transcription to a local ollama server and ouput tts audio responses☆350Updated last year
- The Fastest Way to Fine-Tune LLMs Locally☆320Updated 6 months ago