Everything I know about running LLMs locally
☆1,829Jul 10, 2026Updated last month
Alternatives and similar repositories for local-llm
Users that are interested in local-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, M…☆2,124Aug 31, 2026Updated last week
- Local-first AI agents with governed, approval-gated memory. Any model provider; MCP tools and web search built in. Nothing remembered wit…☆352Aug 31, 2026Updated last week
- Wireshark for MCP. A transparent proxy that shows every real tool call between your AI client and your MCP servers, live in your terminal…☆347Aug 26, 2026Updated last week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆27,002Updated this week
- Shadow any website for offline viewing, with the JavaScript stripped out☆3,374Aug 10, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,241Sep 1, 2026Updated last week
- 14MB foundation model for tiny devices; phones, wearables, smart home, and robots.☆10,499Updated this week
- Stop wasting tokens and re-explaining your project every session. Recall gives Claude Code durable memory — entirely offline.☆745Jul 31, 2026Updated last month
- A visualization tool that replays coding-agent sessions on a 3D map of your codebase.☆1,324Aug 10, 2026Updated 3 weeks ago
- Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.☆3,358Updated this week
- 🌱 Private, quiet space for thinking. Simple app for .md files.☆4,134Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆22,135Updated this week
- autonomous red teaming platform; multi-agent offensive-security meta-harness☆6,035Updated this week
- Hundreds of models & providers. One command to find what runs on your hardware.☆35,009Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Generate hands-on, multi-part technical tutorials on demand, with LLM skills tuned to make content approachable. Then you work through th…☆1,662Aug 3, 2026Updated last month
- Simple CLI tool for deterministic routing of queries between local and hosted LLM models☆412Updated this week
- Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise lin…☆22,034Updated this week
- Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.☆4,074Updated this week
- Use Claude Code's autonomous agent loop with DeepSeek V4 Pro, OpenRouter, or any Anthropic-compatible backend. Same UX, 17x cheaper.☆2,259Jul 23, 2026Updated last month
- Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.☆148Aug 4, 2026Updated last month
- Running a big model on a small laptop☆4,087Mar 19, 2026Updated 5 months ago
- Skills for threat modeling, scanning, triage, patching, plus an autonomous scanning harness you can /customize☆7,415Aug 6, 2026Updated last month
- Run models too big for your Mac's memory☆666Aug 27, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Beautiful, AI-native markdown IDE and LLM wiki☆4,077Updated this week
- Unlimited OCR Works: Welcome the Era of One-shot Long-horizon Parsing.☆25,351Jul 29, 2026Updated last month
- Branchable computing by using a portable, lightweight, self-contained virtual machine☆5,985Updated this week
- A notebook that compares a reasoning model x a non reasoning model that runs a loop using logprobs found uncertainty☆25Aug 18, 2025Updated last year
- Fast and Accurate Code Search for Agents. Uses 99% fewer tokens than grep+read☆6,013Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆53,999Updated this week
- Local-first, zero-trust agentic IDE for verifiable autonomous software development.☆864Updated this week
- Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality…☆1,480Updated this week
- A guide for how to use your smartphone to code anywhere at anytime.☆1,733Jan 15, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking☆921Updated this week
- RL-training an AI agent to RL-train AI agents.☆236Jul 14, 2026Updated last month
- A ~9M parameter LLM that talks like a small fish.☆3,441Apr 15, 2026Updated 4 months ago
- OpenWiki is a CLI that writes and maintains agent documentation for your codebase.☆16,197Updated this week
- Open-source AI coworker, with memory☆17,490Updated this week
- Agent Lattice: a knowledge graph for your codebase, written in markdown.☆1,906Updated this week
- ☆573May 30, 2026Updated 3 months ago