Everything I know about running LLMs locally
☆1,660Jul 10, 2026Updated 2 weeks ago
Alternatives and similar repositories for local-llm
Users that are interested in local-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, M…☆1,879Updated this week
- Persistent AI rooms with governed, approval-gated memory: local-first, on your machine.☆240Updated this week
- Wireshark for MCP. A transparent proxy that shows every real tool call between your AI client and your MCP servers, live in your terminal…☆311Updated this week
- Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆20,466Updated this week
- Shadow any website for offline viewing, with the JavaScript stripped out☆2,967Jul 11, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,206Updated this week
- Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.☆3,296Updated this week
- A visualization tool that replays coding-agent sessions on a 3D map of your codebase.☆943Jul 18, 2026Updated last week
- Stop wasting tokens and re-explaining your project every session. Recall gives Claude Code durable memory — entirely offline.☆730Updated this week
- Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.☆2,943Updated this week
- Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.☆883Updated this week
- 🌱 Private, quiet space for thinking. Simple app for .md files.☆4,046Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆19,356Updated this week
- autonomous red teaming platform; multi-agent offensive-security meta-harness☆5,270Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Hundreds of models & providers. One command to find what runs on your hardware.☆30,829Updated this week
- Open-source & free — Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise…☆15,028Updated this week
- Generate hands-on, multi-part technical tutorials on demand, with LLM skills tuned to make content approachable. Then you work through th…☆1,599Jul 20, 2026Updated last week
- Simple CLI tool for deterministic routing of queries between local and hosted LLM models☆400Updated this week
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆687Updated this week
- Use Claude Code's autonomous agent loop with DeepSeek V4 Pro, OpenRouter, or any Anthropic-compatible backend. Same UX, 17x cheaper.☆2,227Updated this week
- Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.☆144Updated this week
- Running a big model on a small laptop☆3,994Mar 19, 2026Updated 4 months ago
- Beautiful, AI-native markdown IDE and LLM wiki☆3,156Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Skills for threat modeling, scanning, triage, patching, plus an autonomous scanning harness you can /customize☆6,862Jul 16, 2026Updated last week
- Run models too big for your Mac's memory☆664Apr 8, 2026Updated 3 months ago
- Unlimited OCR Works: Welcome the Era of One-shot Long-horizon Parsing.☆19,822Updated this week
- Portable, lightweight, self-contained virtual machine.☆4,492Updated this week
- Fast and Accurate Code Search for Agents. Uses ~98% fewer tokens than grep+read☆5,726Updated this week
- A notebook that compares a reasoning model x a non reasoning model that runs a loop using logprobs found uncertainty☆25Aug 18, 2025Updated 11 months ago
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆51,826Updated this week
- Local-first, zero-trust agentic IDE for verifiable autonomous software development.☆859Updated this week
- Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality…☆1,427Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking☆804Updated this week
- A guide for how to use your smartphone to code anywhere at anytime.☆1,732Jan 15, 2026Updated 6 months ago
- RL-training an AI agent to RL-train AI agents.☆224Jul 14, 2026Updated 2 weeks ago
- A ~9M parameter LLM that talks like a small fish.☆3,308Apr 15, 2026Updated 3 months ago
- OpenWiki is a CLI that writes and maintains agent documentation for your codebase.☆13,451Updated this week
- Open-source AI coworker, with memory☆16,861Updated this week
- Agent Lattice: a knowledge graph for your codebase, written in markdown.☆1,792Jul 15, 2026Updated last week