di37 / running-llms-locallyLinks
A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆31Updated 2 months ago
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below
Sorting:
- ☆52Updated last year
- ☆175Updated 6 months ago
- A curated list of awesome AI tools, frameworks, api, software and resources.☆341Updated last year
- This for gen AI crash course which will quickly enable you to make AI applications☆23Updated 4 months ago
- 2025 Release of JFK files - Converted to markdown with doctly.ai☆56Updated 3 months ago
- BeeMCP: an unofficial Model Context Protocol (MCP) server that connects your Bee wearable lifelogger to AI via the Model Context Protocol☆28Updated 3 months ago
- Telos is an open-sourced framework for creating Deep Context about things that matter to humans.☆552Updated 3 months ago
- Welcome!☆140Updated 7 months ago
- The yt command stands for YouTube Transcript, and pulls transcripts from YouTube.☆71Updated 11 months ago
- Template for a new generative ai project using uv, nicegui, fastapi, llms (cloud & local with litellm and ollama) and langfuse for llm ob…☆99Updated last week
- A customizable Retrieval-Augmented Generation (RAG) implementation using Ollama for a private local instance Large Language Model (LLM) a…☆78Updated last month
- LLMExcel is a free, open-source Excel add-in that allows you to use GPT and Anthropic AI models directly within Excel spreadsheets.☆24Updated 8 months ago
- Natural Language Application Development (NLAD) - A methodology for building applications by leveraging LLMs to create higher levels of a…☆99Updated 7 months ago
- A library of shared system prompts for creating customized educational GPT agents.☆178Updated 7 months ago
- A simple demonstration agent using the ReACT methodology for analyzing and executing tasks.☆96Updated 4 months ago
- Docling with Ollama - RAG on Local Files with Local Models☆69Updated 6 months ago
- A collection of community created AI tools to improve your life☆161Updated 9 months ago
- This is a technical writeup of the next evolution in the Adaptive Modular Network. It aims to unify the components of the AMN and fill ga…☆56Updated 3 weeks ago
- Tools for OpenWebUI☆107Updated last month
- A simple application that allows users to chat with local text files using LLMs managed by ollama☆124Updated 11 months ago
- 🚀 Open-source project for creating high-quality AI TTS-narrated audiobooks at home using models like Zonos, Kokoro-82M, or services like…☆39Updated 3 months ago
- An open-source personal API framework.☆78Updated 9 months ago
- 100% Local Memory layer and Knowledge base for agents with WebUI☆234Updated last month
- An AI prompt project that uses AI to extract wisdom from all sorts of text, from podcast transcripts, conversations, talks, lectures, pap…☆99Updated last year
- A package that provides simplified base components to make building and maintaining LLM-powered applications easier.☆110Updated last week
- StreamDeploy offers this free LLM application template leveraging Ollama as the LLM service provider. This llm scaffold leverages Sveltek…☆18Updated last year
- Using Gemma-3 Vision☆90Updated 3 months ago
- Model Context Protocol server implementation for Reddit☆144Updated last week
- Integrate fabric by danielmiessler/fabric into Obsidian☆69Updated 9 months ago
- An Open Source implementation of Notebook LM with more flexibility and features☆41Updated 7 months ago