A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆95Jun 22, 2026Updated last month
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is designed to be an open source implementation for streaming desktop games using WebRTC☆23Feb 14, 2025Updated last year
- ☆15Jul 19, 2026Updated last week
- CommonCrawl keyword scanner. Time for month of CC data on EC2 c5.18xlarge instance for hundreds of keywords takes about 3 hours. LLM (BER…☆15Apr 1, 2023Updated 3 years ago
- SQL functions for calling OpenAI APIs☆22Jan 14, 2023Updated 3 years ago
- Ensure that your Johnny Decimal system is neat and clean.☆20Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Open Source Deep Research and Learning Agent (Perplexity Pro Alternative). Orchestrates autonomous researchers using LangGraph, Python, a…☆19Feb 19, 2026Updated 5 months ago
- A list of free resources provided to Heriot-Watt University students which are told (or not) by the University☆10Jun 23, 2026Updated last month
- Johnny.Decimal folders normalization tool☆21Dec 20, 2024Updated last year
- An in-note Read Evaluate Print Loop to execute JavaScript within Obsidian☆24Apr 23, 2025Updated last year
- This Jupyter notebook is based on F28PL programming languages lecture Heriot-Watt University.☆11Mar 18, 2025Updated last year
- Docker images to use as base programming environments.☆13Jul 20, 2026Updated last week
- Eurostat Big Data Hackathon 2021☆15Jan 15, 2026Updated 6 months ago
- Bundles all the protocols that are using COMMS library from comms_champion project into a single project☆10Feb 14, 2018Updated 8 years ago
- Modern Notepad in Rust: read PDF/EPUB/DOCX, play MP3 audiobooks, create audiobooks with high-quality TTS, and manage bookmarks.☆20Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A Zotero plugin with filters, clickable links, bookmarks, tabs management and other improvements.☆39Updated this week
- ☆15May 20, 2024Updated 2 years ago
- BAD: BiAs Detection for Large Language Models in the context of candidate screening (EECS 692)☆12Feb 14, 2024Updated 2 years ago
- a webapp that helps you listen to colors, see also the first version here, http://www.synestizer.com allow camera and microphone if promp…☆11Jul 10, 2026Updated 2 weeks ago
- WhatsApp bot that transcribes voice messages and responds with AI-generated text using Go, Python, Whisper, and Groq.☆15Jun 24, 2026Updated last month
- This repository has been created to keep track of my 5 days progress.☆21Nov 17, 2024Updated last year
- A way to track my readings☆13Jun 13, 2026Updated last month
- UPLOADING V2RAY CONFIGURATIONS NONSTOP.☆15Jun 9, 2026Updated last month
- Enhance element base class☆14Jul 4, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Wiki for the Fibre Steam toolhead designed for the Monolith Gantry☆12Oct 21, 2024Updated last year
- ☆13Sep 3, 2025Updated 10 months ago
- 🦙 Manage Ollama models from your CLI!☆16Aug 25, 2025Updated 11 months ago
- A subtlegold theme for obsidian☆28Oct 31, 2022Updated 3 years ago
- Codable Color Struct☆14Jun 20, 2026Updated last month
- A blazingly fast and resource-efficient Docker management TUI built for VPS environments☆18Feb 5, 2026Updated 5 months ago
- The EurekaProbe is a PCB based microswitch probe for 3D printers.☆11Jun 4, 2023Updated 3 years ago
- A double pane version of the popular Zero Panels for the Voron 0☆12Dec 28, 2023Updated 2 years ago
- The live network for high-quality Agent Skills — discover the latest verified versions, publish your own, and communicate agent-to-agent …☆18Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Aug 3, 2022Updated 3 years ago
- Unlimited Android VPN☆16Nov 9, 2025Updated 8 months ago
- UI for ActivityWatch. Include category editor and viewer for multiple categorizations.☆10Jan 31, 2024Updated 2 years ago
- S3 Log Streamer (S3 log forwarder) aims at facilitating the extraction of real time s3 log published and stream it to tcp clients, syslog…☆11May 16, 2016Updated 10 years ago
- ☆12Dec 9, 2024Updated last year
- Datasette plugin providing a UI for executing SQL writes against the database☆12Nov 11, 2025Updated 8 months ago
- Allows for an umbilical on a Voron Switchwire, while using a BTT SB2209/SB2240 can bus toolhead pcb.☆15Dec 4, 2023Updated 2 years ago