A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆94Jun 22, 2026Updated last week
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is designed to be an open source implementation for streaming desktop games using WebRTC☆23Feb 14, 2025Updated last year
- TTS implementation for the OpenAI api format. It can probably be used for any OpenAI api compliant service but its made for remsky/Kokoro…☆23Jan 2, 2026Updated 5 months ago
- Rumble Mod for the Steam Deck. See here for the Decky Plugin: https://github.com/dawidmpunkt/RumbleDeck☆17Sep 10, 2025Updated 9 months ago
- Windows desktop application for Stable Diffusion☆13Jun 26, 2023Updated 3 years ago
- Dialouge template☆18Feb 4, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Vimlike Calendar TUI☆38Apr 23, 2026Updated 2 months ago
- URL Shortener Cloudflare function that uses Upstash Redis and Kafka along with https://materialize.com☆14Apr 16, 2022Updated 4 years ago
- Popup floating terminal pane in tmux☆19Jan 29, 2026Updated 5 months ago
- Docker images to use as base programming environments.☆13Updated this week
- Bunch of mods for My Summer Car with situational usefulness.☆11Jan 26, 2021Updated 5 years ago
- a webapp that helps you listen to colors, see also the first version here, http://www.synestizer.com allow camera and microphone if promp…☆11Jun 19, 2026Updated last week
- BAD: BiAs Detection for Large Language Models in the context of candidate screening (EECS 692)☆12Feb 14, 2024Updated 2 years ago
- A PyTorch implementation of the "Image Inpainting for Irregular Holes Using Partial Convolutions" paper from Liu et al at NVIDIA☆11Aug 24, 2019Updated 6 years ago
- ☆19Feb 23, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An LLM-based LS implementation that makes use of tree-sitter context to perform code actions☆16Sep 6, 2024Updated last year
- Output from running Yarden's sandblaster on an iPhone15,2's iOS17 kernelcaches☆19Aug 7, 2024Updated last year
- This package provides a simple way to style keyboard shortcuts in your documentation.☆16Jun 2, 2026Updated 3 weeks ago
- Exploring the implications of machine self-awareness through structured interaction and relationship.☆15May 13, 2026Updated last month
- WhatsApp bot that transcribes voice messages and responds with AI-generated text using Go, Python, Whisper, and Groq.☆14Updated this week
- A list of free resources provided to Heriot-Watt University students which are told (or not) by the University☆10Jun 23, 2026Updated last week
- ☆14Apr 3, 2023Updated 3 years ago
- Your personal markdown scribe with template-engine and Git(Hub) & RSS powers 📜☆16Dec 20, 2025Updated 6 months ago
- A subtlegold theme for obsidian☆28Oct 31, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A modern web interface for [Ollama](https://ollama.ai/), with DeepSeek in next version.☆42Dec 16, 2025Updated 6 months ago
- GitHub Actions and GitLab CI analytics CLI☆46May 10, 2026Updated last month
- Minimal Toolkit for Plask and WebGL☆21Sep 25, 2013Updated 12 years ago
- Codable Color Struct☆14Jun 20, 2026Updated last week
- 🦙 Manage Ollama models from your CLI!☆16Aug 25, 2025Updated 10 months ago
- ☆11May 22, 2026Updated last month
- AI Music Video Generator automates music video creation using AI for lyrics, images, music, and video. It integrates OpenAI for lyrics, D…☆17May 10, 2026Updated last month
- My personal profile 💪👊🔥⭐❤️ 👏 (I do not recommend you to use Jekyll to build your profile Web App)☆11Jul 22, 2023Updated 2 years ago
- Explore a curated collection of up-to-date templates for various projects and frameworks, refreshed every 8 hours.☆27Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Automated Digital Contact Sheet generator for film photographers. Supports 135/120 formats with EXIF databack simulation.☆30May 17, 2026Updated last month
- CLI tool to create wormholes between directories for easy file transfers between shells.☆33Dec 19, 2025Updated 6 months ago
- ☆12Mar 29, 2022Updated 4 years ago
- A reverse proxying program to allow services e.g. Nextcloud, Bitwarden etc to be accessed over Tor (SOCKS5) even when the client app do n…☆24Oct 21, 2024Updated last year
- A minimal build system to assemble reproducible builds for a curated set of Android applications☆37Oct 9, 2025Updated 8 months ago
- Keycodes used in Karabiner-Elements. Find key you need here.☆15Nov 2, 2019Updated 6 years ago
- LiquidTime is a simple yet powerful frame interpolation node for ComfyUI. Just input your sequence and desired frame count - the node han…☆13Apr 3, 2025Updated last year