TheBloke's Dockerfiles
☆308Mar 8, 2024Updated last year
Alternatives and similar repositories for dockerLLM
Users that are interested in dockerLLM are comparing it to the libraries listed below
Sorting:
- ☆50Oct 10, 2023Updated 2 years ago
- ☆17Aug 18, 2023Updated 2 years ago
- ☆54Jun 11, 2023Updated 2 years ago
- ☆27Aug 30, 2023Updated 2 years ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Sep 26, 2023Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,913Sep 30, 2023Updated 2 years ago
- Local text-to-speech in your browser with Piper TTS☆17Aug 13, 2025Updated 6 months ago
- Interact privately with your documents using the power of GPT, 100% privately, no data leaks☆41Oct 2, 2023Updated 2 years ago
- Customizable implementation of the self-instruct paper.☆1,049Mar 7, 2024Updated last year
- Tools for formatting large language model prompts.☆13Dec 19, 2023Updated 2 years ago
- Web UI for ExLlamaV2☆512Feb 5, 2025Updated last year
- Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts a…☆25Apr 18, 2023Updated 2 years ago
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated last year
- Merge Transformers language models by use of gradient parameters.☆214Aug 8, 2024Updated last year
- Self-evaluating interview for AI coders☆601Jun 21, 2025Updated 8 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,444Dec 9, 2025Updated 2 months ago
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆5,026Apr 11, 2025Updated 10 months ago
- The definitive Web UI for local AI, with powerful features and easy setup.☆46,091Feb 3, 2026Updated 3 weeks ago
- Lord of Large Language and Multi modal Systems Web User Interface☆4,771Updated this week
- ☆19Sep 4, 2024Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆402Updated this week
- fork of litellm that is open source☆22Jan 22, 2026Updated last month
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,477Jun 7, 2025Updated 8 months ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,888Feb 20, 2026Updated last week
- Turns KoboldAI into a crowdsourced distributed cluster☆33Oct 19, 2023Updated 2 years ago
- Okra, your all in one personal AI assistant☆14Jun 14, 2024Updated last year
- This project showcases engaging interactions between two AI chatbots.☆10Jan 10, 2024Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,881Jan 28, 2024Updated 2 years ago
- ☆55Aug 29, 2023Updated 2 years ago
- Large Language Model Text Generation Inference☆10,788Jan 8, 2026Updated last month
- ☆39Dec 14, 2024Updated last year
- Go ahead and axolotl questions☆11,335Updated this week
- Harness LLMs with Multi-Agent Programming☆3,909Updated this week
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆145Oct 17, 2023Updated 2 years ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,134Feb 9, 2026Updated 2 weeks ago
- Falcon LLM ggml framework with CPU and GPU support☆249Jan 22, 2024Updated 2 years ago
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Oct 21, 2024Updated last year
- ☆535Dec 1, 2023Updated 2 years ago