A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆84Mar 16, 2026Updated last week
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- USB keyboard interface for C64☆14Jul 31, 2024Updated last year
- typing☆18Oct 18, 2025Updated 5 months ago
- erlang docset by Dash☆15Jul 24, 2012Updated 13 years ago
- TTS implementation for the OpenAI api format. It can probably be used for any OpenAI api compliant service but its made for remsky/Kokoro…☆21Jan 2, 2026Updated 2 months ago
- Opensource uPlay API Emulator☆13Jan 25, 2016Updated 10 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Rumble Mod for the Steam Deck. See here for the Decky Plugin: https://github.com/dawidmpunkt/RumbleDeck☆15Sep 10, 2025Updated 6 months ago
- Windows desktop application for Stable Diffusion☆13Jun 26, 2023Updated 2 years ago
- An application that helps you notify your friends and/or family if you've gone missing.☆11Jan 28, 2017Updated 9 years ago
- ExpressJs v4 Snippets for VS Code☆12Feb 4, 2022Updated 4 years ago
- a webapp that helps you listen to colors, see also the first version here, http://www.synestizer.com allow camera and microphone if promp…☆11Jan 9, 2026Updated 2 months ago
- A beautiful interactive music widget for wayland☆25Mar 16, 2026Updated last week
- A PyTorch implementation of the "Image Inpainting for Irregular Holes Using Partial Convolutions" paper from Liu et al at NVIDIA☆10Aug 24, 2019Updated 6 years ago
- A real-time Medical Transcription analysis app☆22Aug 14, 2024Updated last year
- Chrome extension to search MDN within omnibox itself☆21Mar 11, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- The userland component of rootpipe fix for Mavericks☆14Apr 13, 2015Updated 10 years ago
- Use Segment Anything 3 to label data for use with Autodistill.☆45Nov 25, 2025Updated 4 months ago
- Minimal Toolkit for Plask and WebGL☆21Sep 25, 2013Updated 12 years ago
- Codable Color Struct☆14Jan 15, 2026Updated 2 months ago
- CLI tool to create wormholes between directories for easy file transfers between shells.☆32Dec 19, 2025Updated 3 months ago
- Library to ease porting userland OpenBSD code to Serenity☆15Mar 14, 2020Updated 6 years ago
- ☆12Mar 29, 2022Updated 3 years ago
- Decktricks is a controller-friendly installer and launcher for third-party programs in Game Mode on SteamOS and Steam Deck.☆15Sep 8, 2025Updated 6 months ago
- Keycodes used in Karabiner-Elements. Find key you need here.☆15Nov 2, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- LiquidTime is a simple yet powerful frame interpolation node for ComfyUI. Just input your sequence and desired frame count - the node han…☆13Apr 3, 2025Updated 11 months ago
- This repo explains how to use a DSLR camera as a webcam on Ubuntu.☆11Dec 4, 2023Updated 2 years ago
- 🎷 The easiest way to find local Jazz events around your area in Tokyo!☆16Jan 31, 2019Updated 7 years ago
- Talk to your database as if you were chatting with a friend. Turn natural language into powerful SQL queries effortlessly, and get your a…☆10Nov 12, 2024Updated last year
- A mechanism for permanent SteamOS modifications via systemd-sysext☆19Jan 7, 2026Updated 2 months ago
- Host-free RSS reader in your browser.☆19Jul 28, 2025Updated 7 months ago
- Lets build a homebrew steam deck controller!☆20Aug 1, 2025Updated 7 months ago
- Elevating Chess Strategy with Fine-Tuned Large Language Model☆17Dec 8, 2023Updated 2 years ago
- 📦 Ergonomic, responsive React layout and grid system☆13Aug 28, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🏫 Egyszerű keresés és letöltés az érettségi feladatsorokhoz.☆15Mar 17, 2026Updated last week
- pacsDisplay Software☆19Mar 16, 2026Updated last week
- Intentionally vulnerable Ruby on Rails web application for learning purposes☆17Sep 11, 2009Updated 16 years ago
- An example Ruby program to demonstrate the "pure function as an object" pattern.☆10Dec 11, 2017Updated 8 years ago
- [KAIST AI618] CycleGAN implementation for CT denoising☆18Jun 9, 2024Updated last year
- A TUI app to find and add packages to NixOS declaratively☆26Jan 13, 2026Updated 2 months ago
- Read & Paste the whole clipboard , count chars , with enhanced visual feedback☆35Jul 19, 2025Updated 8 months ago