This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
☆295Jul 12, 2024Updated last year
Alternatives and similar repositories for local_llama
Users that are interested in local_llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Gradio based tool to run opensource LLM models directly from Huggingface☆99Jun 27, 2024Updated last year
- A Kotlin based terminal command to interact with the OpenAI Assistants API in a slightly geeky way...☆14Jun 23, 2024Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference☆24May 18, 2023Updated 3 years ago
- ☆14May 25, 2023Updated 2 years ago
- Prompt Development Environment for GPT☆14Jul 23, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Host LLM via text-generation-inference☆16Dec 5, 2023Updated 2 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 2 years ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆35May 11, 2026Updated last week
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆215Jun 25, 2023Updated 2 years ago
- PaLM-Kosmos-Vision is a foundational project showcasing basic ChatGPT with vision capabilities, inviting further development for advanced…☆16Nov 15, 2023Updated 2 years ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated 2 years ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆60Dec 1, 2024Updated last year
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆37Aug 28, 2024Updated last year
- Tool for chatting with your codebase and docs using OpenAI, LlamaCpp, and GPT-4-All☆511Nov 18, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Harnessing the Memory Power of the Camelids☆147Oct 19, 2023Updated 2 years ago
- AI Based "Happiness Optimizer"☆12Oct 20, 2024Updated last year
- GPT chat with your docs!☆142Jan 17, 2025Updated last year
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Jan 28, 2024Updated 2 years ago
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated 2 years ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- ☆10Oct 18, 2023Updated 2 years ago
- Writing Extension for Text Generation WebUI☆67Aug 7, 2025Updated 9 months ago
- Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …☆161Aug 20, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Domain Agnostic Prompts for Savvy Professionals☆10Feb 7, 2023Updated 3 years ago
- A Python micro framework for creating LLM-driven agents☆23May 20, 2025Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Jan 19, 2024Updated 2 years ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆31May 1, 2025Updated last year
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated last year
- Translate English to SQL and Python Pandas with OpenAI's GPT-3 Codex model☆21Mar 22, 2023Updated 3 years ago
- Erudito: Easy API/CLI to ask questions about your documentation☆98Nov 6, 2023Updated 2 years ago
- A simple user interface for interacting with AI☆46Oct 14, 2025Updated 7 months ago
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An implemention of GraphRAG using open source small LLMs☆14Nov 9, 2024Updated last year
- CopperAI offers a hands-free, voice-to-voice interaction system with a Large Language Model (LLM)☆29Nov 20, 2023Updated 2 years ago
- A minimal CLI tool for piping anything into an LLM.☆21Jan 1, 2026Updated 4 months ago
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆154Dec 18, 2024Updated last year
- A multi-agent business consultant app on streamlit implemented using crewAI☆18Jul 5, 2024Updated last year
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆33Dec 29, 2025Updated 4 months ago
- Dumb experiment exploring Clean Architecture☆11Dec 22, 2018Updated 7 years ago