TheBloke's Dockerfiles
☆308Mar 8, 2024Updated 2 years ago
Alternatives and similar repositories for dockerLLM
Users that are interested in dockerLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆50Oct 10, 2023Updated 2 years ago
- ☆17Aug 18, 2023Updated 2 years ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Sep 26, 2023Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,915Sep 30, 2023Updated 2 years ago
- ☆28Aug 30, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Falcon LLM ggml framework with CPU and GPU support☆249Jan 22, 2024Updated 2 years ago
- Interact privately with your documents using the power of GPT, 100% privately, no data leaks☆42Oct 2, 2023Updated 2 years ago
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated last year
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- Web UI for ExLlamaV2☆511Feb 5, 2025Updated last year
- The original local LLM interface. Text, vision, tool-calling, training. UI + API, 100% offline and private.☆46,874Updated this week
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆5,059Apr 11, 2025Updated last year
- ☆17Jul 20, 2023Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆17May 17, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Tools for formatting large language model prompts.☆13Dec 19, 2023Updated 2 years ago
- Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts a…☆25Apr 18, 2023Updated 3 years ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆12Feb 11, 2024Updated 2 years ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,511Mar 4, 2026Updated last month
- Merge Transformers language models by use of gradient parameters.☆214Aug 8, 2024Updated last year
- A simple Discord bot for doing AI stuff with☆10Mar 1, 2026Updated 2 months ago
- Self-evaluating interview for AI coders☆599Jun 21, 2025Updated 10 months ago
- Turns KoboldAI into a crowdsourced distributed cluster☆33Oct 19, 2023Updated 2 years ago
- A free AI text generation interface based on KoboldAI☆33Feb 27, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An experimental open-source attempt to make GPT-4 fully autonomous.☆27Oct 27, 2023Updated 2 years ago
- AI Powered Terminal (Powershell)☆42May 2, 2024Updated 2 years ago
- Large Language Model Text Generation Inference☆10,848Mar 21, 2026Updated last month
- ☆19Sep 4, 2024Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,481Jun 7, 2025Updated 10 months ago
- Lord of Large Language and Multi modal Systems Web User Interface☆4,782Apr 26, 2026Updated last week
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- LM Studio JSON configuration file format and a collection of example config files.☆212Aug 5, 2024Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆430Apr 23, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across div…☆3,180Updated this week
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- Spring Petclinic application with a chatbot powered by OpenAI's Generative AI and the LangChain4j project☆20Dec 23, 2025Updated 4 months ago
- 4 bits quantization of LLaMA using GPTQ☆3,072Jul 13, 2024Updated last year
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,474Mar 1, 2024Updated 2 years ago
- Go ahead and axolotl questions☆11,779Updated this week