Everything I know about running LLMs locally
☆1,778Jul 10, 2026Updated last month
Alternatives and similar repositories for local-llm
Users that are interested in local-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, M…☆2,033Updated this week
- Local-first AI agents with governed, approval-gated memory. Any model provider; MCP tools and web search built in. Nothing remembered wit…☆333Updated this week
- Wireshark for MCP. A transparent proxy that shows every real tool call between your AI client and your MCP servers, live in your terminal…☆339Updated this week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆25,406Updated this week
- Shadow any website for offline viewing, with the JavaScript stripped out☆3,251Aug 10, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,219Updated this week
- 14MB foundation model for tiny devices; phones, wearables, smart home, and robots.☆7,505Updated this week
- A visualization tool that replays coding-agent sessions on a 3D map of your codebase.☆1,248Aug 10, 2026Updated last week
- Stop wasting tokens and re-explaining your project every session. Recall gives Claude Code durable memory — entirely offline.☆741Jul 31, 2026Updated 2 weeks ago
- Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.☆3,256Updated this week
- Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.☆965Updated this week
- 🌱 Private, quiet space for thinking. Simple app for .md files.☆4,095Jul 29, 2026Updated 2 weeks ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆21,528Aug 9, 2026Updated last week
- autonomous red teaming platform; multi-agent offensive-security meta-harness☆5,605Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Hundreds of models & providers. One command to find what runs on your hardware.☆32,727Updated this week
- Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise lin…☆20,726Updated this week
- Generate hands-on, multi-part technical tutorials on demand, with LLM skills tuned to make content approachable. Then you work through th…☆1,648Aug 3, 2026Updated 2 weeks ago
- Simple CLI tool for deterministic routing of queries between local and hosted LLM models☆411Updated this week
- Use Claude Code's autonomous agent loop with DeepSeek V4 Pro, OpenRouter, or any Anthropic-compatible backend. Same UX, 17x cheaper.☆2,250Jul 23, 2026Updated 3 weeks ago
- Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.☆146Aug 4, 2026Updated 2 weeks ago
- Running a big model on a small laptop☆4,072Mar 19, 2026Updated 4 months ago
- Beautiful, AI-native markdown IDE and LLM wiki☆3,497Updated this week
- Skills for threat modeling, scanning, triage, patching, plus an autonomous scanning harness you can /customize☆7,313Aug 6, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run models too big for your Mac's memory☆666Apr 8, 2026Updated 4 months ago
- Unlimited OCR Works: Welcome the Era of One-shot Long-horizon Parsing.☆24,068Jul 29, 2026Updated 2 weeks ago
- A notebook that compares a reasoning model x a non reasoning model that runs a loop using logprobs found uncertainty☆25Aug 18, 2025Updated last year
- Fast and Accurate Code Search for Agents. Uses 99% fewer tokens than grep+read☆5,897Updated this week
- Portable, lightweight, self-contained virtual machine.☆5,488Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆52,955Updated this week
- Local-first, zero-trust agentic IDE for verifiable autonomous software development.☆862Updated this week
- Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality…☆1,460Updated this week
- Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking☆840Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A guide for how to use your smartphone to code anywhere at anytime.☆1,737Jan 15, 2026Updated 7 months ago
- RL-training an AI agent to RL-train AI agents.☆234Jul 14, 2026Updated last month
- A ~9M parameter LLM that talks like a small fish.☆3,418Apr 15, 2026Updated 4 months ago
- OpenWiki is a CLI that writes and maintains agent documentation for your codebase.☆15,288Updated this week
- Open-source AI coworker, with memory☆17,316Updated this week
- Agent Lattice: a knowledge graph for your codebase, written in markdown.☆1,832Updated this week
- ☆498May 30, 2026Updated 2 months ago