vince-lam / awesome-local-llmsLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆575Updated 3 weeks ago
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,558Updated 6 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆594Updated 7 months ago
- Large-scale LLM inference engine☆1,440Updated last week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆567Updated 3 months ago
- LLM Frontend in a single html file☆487Updated 4 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆319Updated 8 months ago
- An AI assistant beyond the chat box.☆329Updated last year
- Efficient visual programming for AI language models☆362Updated 3 weeks ago
- The Fastest Way to Fine-Tune LLMs Locally☆300Updated 2 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆745Updated last month
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆634Updated 4 months ago
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆470Updated 4 months ago
- Web UI for ExLlamaV2☆495Updated 4 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆401Updated 4 months ago
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆508Updated 3 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆316Updated 3 months ago
- Code for Papeg.ai☆224Updated 5 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆969Updated last week
- ♾️ Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…☆501Updated this week
- Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and Comf…☆465Updated last month
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit☆771Updated 9 months ago
- A proxy server for multiple ollama instances with Key security☆436Updated last month
- A fast batching API to serve LLM models☆181Updated last year
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆553Updated 4 months ago
- Software to implement GoT with a weviate vectorized database☆669Updated 2 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆385Updated 4 months ago
- LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for …☆759Updated this week
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆848Updated last week
- List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search☆883Updated last week
- ☆203Updated 2 weeks ago