TheBlokeAI / dockerLLM
TheBloke's Dockerfiles
☆299Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for dockerLLM
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆242Updated last week
- An Autonomous LLM Agent that runs on Wizcoder-15B☆339Updated 2 weeks ago
- ☆52Updated last year
- Harnessing the Memory Power of the Camelids☆145Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆244Updated 9 months ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆211Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆175Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated last year
- A fast batching API to serve LLM models☆172Updated 6 months ago
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆139Updated 6 months ago
- Local LLM ReAct Agent with Guidance☆154Updated last year
- A prompt/context management system☆165Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 6 months ago
- An AI assistant beyond the chat box.☆315Updated 7 months ago
- Real-time Fallacy Detection using OpenAI whisper and ChatGPT/LLaMA/Mistral☆107Updated 11 months ago
- A Simple Discord Bot for the Alpaca LLM☆102Updated last year
- Web UI for ExLlamaV2☆438Updated last month
- Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.☆170Updated 3 weeks ago
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆167Updated this week
- ☆168Updated last year
- A multimodal, function calling powered LLM webui.☆205Updated last month
- Text WebUI extension to add clever Notebooks to Chat mode☆133Updated 10 months ago
- ☆55Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆143Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆160Updated 3 months ago
- ☆275Updated last year
- A discord bot that roleplays!☆145Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Updated last year