vince-lam / awesome-local-llmsView external linksLinks
Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆713Nov 7, 2025Updated 3 months ago
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below
Sorting:
- An awesome repository of local AI tools☆1,834Nov 13, 2024Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year
- a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker …☆110May 31, 2024Updated last year
- Cookbook for Crafting Good Code☆57Mar 19, 2024Updated last year
- Rust implementation of Surya☆65Mar 1, 2025Updated 11 months ago
- ☆51May 31, 2024Updated last year
- Efficient visual programming for AI language models☆360May 13, 2025Updated 9 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated last year
- Large-scale LLM inference engine☆1,651Jan 21, 2026Updated 3 weeks ago
- A pipeline parallel training script for LLMs.☆166Apr 30, 2025Updated 9 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- Develop, evaluate and monitor LLM applications at scale☆100Nov 29, 2024Updated last year
- 🏗️ Fine-tune, build, and deploy open-source LLMs easily!☆508Feb 9, 2026Updated last week
- automatically quant GGUF models☆219Dec 23, 2025Updated last month
- LLM全栈优质资源汇总☆676Jul 15, 2025Updated 7 months ago
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.☆386Mar 13, 2024Updated last year
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 8 months ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆9,462Feb 10, 2026Updated last week
- One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆2,424Updated this week
- A multimodal, function calling powered LLM webui.☆216Sep 23, 2024Updated last year
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆42,767Updated this week
- A cross platform App that gives you the best UX to run models locally or remotely on your own hardware☆73Dec 22, 2025Updated last month
- Web UI for ExLlamaV2☆513Feb 5, 2025Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆108Jul 29, 2025Updated 6 months ago
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆582Jun 22, 2025Updated 7 months ago
- Track and Collaborate on ML & AI Experiments.☆44Mar 10, 2025Updated 11 months ago
- A QT GUI for large language models☆39Dec 27, 2023Updated 2 years ago
- Make triton easier☆50Jun 12, 2024Updated last year
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆54,624Updated this week
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 5 months ago
- Distribute and run LLMs with a single file.☆23,704Feb 10, 2026Updated last week
- Local AI API Platform☆2,762Jul 4, 2025Updated 7 months ago
- ☆307Aug 17, 2025Updated 5 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,445Dec 9, 2025Updated 2 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,129Feb 9, 2026Updated last week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆35,968Updated this week
- The official GitHub page for the survey paper "A Survey on Data Augmentation in Large Model Era"☆132Jul 10, 2024Updated last year
- AI assistant that Intuitively Adapts to You☆79Feb 2, 2024Updated 2 years ago
- ☆14Aug 25, 2024Updated last year