A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆85Mar 30, 2026Updated 3 weeks ago
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is designed to be an open source implementation for streaming desktop games using WebRTC☆23Feb 14, 2025Updated last year
- Code and documentation for SunFounder Elite Explorer Kit☆12Feb 12, 2026Updated 2 months ago
- Unofficial GNOME Boxes, an application that gives you access to virtual machines.☆13Apr 11, 2026Updated last week
- This repo covers the different guardrail options available in the market☆25Oct 2, 2025Updated 6 months ago
- Memory that learns what works.☆115Jan 27, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- TTS implementation for the OpenAI api format. It can probably be used for any OpenAI api compliant service but its made for remsky/Kokoro…☆22Jan 2, 2026Updated 3 months ago
- Windows desktop application for Stable Diffusion☆13Jun 26, 2023Updated 2 years ago
- Dialouge template☆17Feb 4, 2025Updated last year
- A Vimlike Calendar TUI☆36Apr 8, 2026Updated last week
- customized version of UCI2WB adapter by H.G.Muller☆11Oct 25, 2019Updated 6 years ago
- Docker images to use as base programming environments.☆13Updated this week
- a webapp that helps you listen to colors, see also the first version here, http://www.synestizer.com allow camera and microphone if promp…☆11Jan 9, 2026Updated 3 months ago
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆13Aug 17, 2023Updated 2 years ago
- Visual (curses) interface to AppMan (AppImage Manager)☆24Feb 4, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Feb 23, 2026Updated last month
- A beautiful interactive music widget for wayland☆24Updated this week
- A PyTorch implementation of the "Image Inpainting for Irregular Holes Using Partial Convolutions" paper from Liu et al at NVIDIA☆10Aug 24, 2019Updated 6 years ago
- An LLM-based LS implementation that makes use of tree-sitter context to perform code actions☆16Sep 6, 2024Updated last year
- A beautiful Terminal User Interface (TUI) for managing your Restic backup repositories, inspired by lazydocker and lazygit.☆28Dec 31, 2025Updated 3 months ago
- Exploring the implications of machine self-awareness through structured interaction and relationship.☆14Apr 8, 2026Updated last week
- WhatsApp bot that transcribes voice messages and responds with AI-generated text using Go, Python, Whisper, and Groq.☆13Nov 17, 2025Updated 5 months ago
- smartchess - chess graphical user interface☆10Apr 30, 2018Updated 7 years ago
- A subtlegold theme for obsidian☆28Oct 31, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Codable Color Struct☆14Jan 15, 2026Updated 3 months ago
- Serve Bubble Tea apps through the browser - Drinking tea through the browser 🍵☆23Apr 8, 2026Updated last week
- AI Music Video Generator automates music video creation using AI for lyrics, images, music, and video. It integrates OpenAI for lyrics, D…☆14Jul 26, 2025Updated 8 months ago
- CLI tool to create wormholes between directories for easy file transfers between shells.☆32Dec 19, 2025Updated 4 months ago
- 🦙 Manage Ollama models from your CLI!☆16Aug 25, 2025Updated 7 months ago
- ☆13Sep 3, 2025Updated 7 months ago
- ☆12Mar 29, 2022Updated 4 years ago
- Golang client for ntfy☆16Nov 27, 2025Updated 4 months ago
- Keycodes used in Karabiner-Elements. Find key you need here.☆15Nov 2, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Talk to your database as if you were chatting with a friend. Turn natural language into powerful SQL queries effortlessly, and get your a…☆10Nov 12, 2024Updated last year
- Disk usage explorer with a TUI and live treemap☆123Updated this week
- ☆12Dec 9, 2024Updated last year
- Host-free RSS reader in your browser.☆19Jul 28, 2025Updated 8 months ago
- A very simple DICOM web viewer☆14Updated this week
- This repo provides a simple GUI for upscaling images and videos, based on Real-ESRGAN ncnn Vulkan, with features for pausing/canceling an…☆19Feb 19, 2025Updated last year
- A Typst package for easy-to-use but powerful and smart margin notes.☆22Apr 2, 2025Updated last year