Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
☆765May 23, 2026Updated 3 weeks ago
Alternatives and similar repositories for awesome-local-llms
Users that are interested in awesome-local-llms are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An awesome repository of local AI tools☆1,978Nov 13, 2024Updated last year
- A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs).☆11Dec 20, 2024Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
- a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker …☆109May 31, 2024Updated 2 years ago
- Cookbook for Crafting Good Code☆57Mar 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rust implementation of Surya☆67Mar 1, 2025Updated last year
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- Large-scale LLM inference engine☆1,767May 8, 2026Updated last month
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 9 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated 2 years ago
- Efficient visual programming for AI language models☆359May 13, 2025Updated last year
- A pipeline parallel training script for LLMs.☆169Apr 30, 2025Updated last year
- Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆3,082Updated this week
- A multimodal, function calling powered LLM webui.☆213Sep 23, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is an example of creating an AI agent with flowchart☆12Jul 22, 2024Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆110Jul 29, 2025Updated 10 months ago
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆46,908Updated this week
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆169May 1, 2024Updated 2 years ago
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.☆387Mar 13, 2024Updated 2 years ago
- LLM全栈优质资源汇总☆719Jul 15, 2025Updated 11 months ago
- ☆51May 31, 2024Updated 2 years ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆10,788Updated this week
- ☆14Aug 25, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Distribute and run LLMs with a single file.☆24,950Jun 9, 2026Updated last week
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience☆61,557Jun 13, 2026Updated last week
- Web UI for ExLlamaV2☆512Feb 5, 2025Updated last year
- 🏗️ Fine-tune, build, and deploy open-source LLMs easily!☆528Updated this week
- Develop, evaluate and monitor LLM applications at scale☆98Nov 29, 2024Updated last year
- The official GitHub page for the survey paper "A Survey on Data Augmentation in Large Model Era"☆136Jul 10, 2024Updated last year
- automatically quant GGUF models☆227Dec 23, 2025Updated 5 months ago
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆13Oct 21, 2024Updated last year
- A bot that checks your grammar and phrasing using LLM of choice☆33Feb 6, 2025Updated last year
- Make triton easier☆50Jun 12, 2024Updated 2 years ago
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.☆43,066Updated this week
- A list of AI autonomous agents☆28,324Feb 26, 2025Updated last year
- AI assistant that Intuitively Adapts to You☆80Feb 2, 2024Updated 2 years ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,556Mar 4, 2026Updated 3 months ago