di37 / running-llms-locallyLinks
A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-effective AI without cloud dependencies.
☆41Updated 4 months ago
Alternatives and similar repositories for running-llms-locally
Users that are interested in running-llms-locally are comparing it to the libraries listed below
Sorting:
- ☆179Updated 8 months ago
- LM Studio JSON configuration file format and a collection of example config files.☆204Updated last year
- LLMExcel is a free, open-source Excel add-in that allows you to use GPT and Anthropic AI models directly within Excel spreadsheets.☆28Updated 9 months ago
- WIP: Open WebUI Chrome Extension (Requires Open WebUI v0.2.0+)☆152Updated last year
- An Open-source Framework for Human Understanding, Meaning, and Progress.☆552Updated 6 months ago
- Build an AI Agent from Libraries of Functions -- My most advanced agent framework☆122Updated 2 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆634Updated last week
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆220Updated this week
- A document based RAG application☆127Updated 5 months ago
- An open-source personal API framework.☆85Updated 11 months ago
- beep boop 🤖 (experimental)☆114Updated 7 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆826Updated 4 months ago
- An AI prompt project that uses AI to extract wisdom from all sorts of text, from podcast transcripts, conversations, talks, lectures, pap…☆108Updated last year
- open source assistant using small models (2b - 5b) , with agentic and tool calling capabilities and integration of RAG with effiecient …☆209Updated 2 weeks ago
- Add/remove knowledge from local files/folder.☆22Updated 3 months ago
- The yt command stands for YouTube Transcript, and pulls transcripts from YouTube.☆74Updated last year
- Telos is an open-sourced framework for creating Deep Context about things that matter to humans.☆715Updated 5 months ago
- A web interface for the Bee AI that uses your api key☆20Updated last month
- Python program to make LLM agents play characters and talk to each other.☆70Updated 2 weeks ago
- Provides an API to the Fabric, and its helper tools☆40Updated last year
- Docling with Ollama - RAG on Local Files with Local Models☆73Updated 8 months ago
- A customizable Retrieval-Augmented Generation (RAG) implementation using Ollama for a private local instance Large Language Model (LLM) a…☆86Updated 2 months ago
- ☆55Updated 11 months ago
- Welcome!☆141Updated 8 months ago
- LLMX; Easiest 3rd party Local LLM UI for the web!☆269Updated this week
- Convert your idea to a plan☆240Updated this week
- An Open Source implementation of Notebook LM with more flexibility and features☆45Updated 9 months ago
- Python app for LM Studio-enhanced voice conversations with local LLMs. Uses Whisper for speech-to-text and offers a privacy-focused, acce…☆109Updated last year
- A collection of projects and guides with Perplexity's Sonar API☆41Updated last week
- MyShelf is an experiment to create a GenAI utility to track reminders, memories, random adhoc information, shopping lists, and more.☆79Updated 7 months ago