TheBlokeAI / dockerLLMLinks
TheBloke's Dockerfiles
☆302Updated last year
Alternatives and similar repositories for dockerLLM
Users that are interested in dockerLLM are comparing it to the libraries listed below
Sorting:
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆174Updated last year
- A prompt/context management system☆169Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆122Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- ☆52Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Updated 7 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- A fast batching API to serve LLM models☆181Updated last year
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆309Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Updated last year
- A multimodal, function calling powered LLM webui.☆214Updated 8 months ago
- Web UI for ExLlamaV2☆495Updated 3 months ago
- ☆157Updated 10 months ago
- RunPod Serverless Worker for Oobabooga Text Generation API for LLMs☆2Updated last year
- Memoir+ a persona memory extension for Text Gen Web UI.☆203Updated last week
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 5 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆238Updated last year
- A langchain based tool to allow agents to dynamically create, use, store, and retrieve tools to solve real world problems☆126Updated last year
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- ☆134Updated last year
- A Simple Discord Bot for the Alpaca LLM☆100Updated last year
- Real-time Fallacy Detection using OpenAI whisper and ChatGPT/LLaMA/Mistral☆115Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆318Updated 2 weeks ago
- The code we currently use to fine-tune models.☆113Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year