xor2k / gpu_undervoltLinks
☆49Updated 2 years ago
Alternatives and similar repositories for gpu_undervolt
Users that are interested in gpu_undervolt are comparing it to the libraries listed below
Sorting:
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆87Updated last week
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆80Updated last month
- ☆88Updated last month
- Linux based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆107Updated 8 months ago
- My personal fork of koboldcpp where I hack in experimental samplers.☆44Updated last year
- GPU Power and Performance Manager☆65Updated last year
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆64Updated 2 months ago
- Easily view and modify JSON datasets for large language models☆86Updated 8 months ago
- NVIDIA Linux open GPU with P2P support☆112Updated last month
- Self-contained, minimalistic implementation of a language model that generates coherent and normal sounding names. It uses an input datas…☆51Updated last year
- Simple monkeypatch to boost AMD Navi 3 GPUs☆47Updated 9 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆24Updated last year
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12Updated 7 months ago
- LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.☆55Updated last year
- ☆53Updated last year
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆109Updated 2 months ago
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆274Updated last week
- Web UI for ExLlamaV2☆514Updated 11 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated 2 years ago
- 100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙☆34Updated 2 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆32Updated 2 years ago
- A prompt/context management system☆169Updated 2 years ago
- Science-driven chatbot development☆61Updated last year
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆68Updated 9 months ago
- Writing Extension for Text Generation WebUI☆64Updated 5 months ago
- Text WebUI extension to add clever Notebooks to Chat mode☆145Updated 5 months ago
- An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets☆69Updated last year
- A community list of common phrases generated by GPT and Claude models☆79Updated 2 years ago
- This repository is about implementing The Personality Cores Conversation System originally developed by Aperture Science, Inc. in the Por…☆25Updated last year