sasha0552 / nvidia-pstatedLinks
A daemon that automatically manages the performance states of NVIDIA GPUs.
☆89Updated last month
Alternatives and similar repositories for nvidia-pstated
Users that are interested in nvidia-pstated are comparing it to the libraries listed below
Sorting:
- GPU Power and Performance Manager☆60Updated 9 months ago
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆27Updated 9 months ago
- ☆80Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆436Updated this week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆156Updated last year
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆47Updated 2 months ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆26Updated last month
- Web UI for ExLlamaV2☆503Updated 5 months ago
- Lightweight Inference server for OpenVINO☆188Updated this week
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆72Updated 8 months ago
- Open source LLM UI, compatible with all local LLM providers.☆175Updated 9 months ago
- InferX is a Inference Function as a Service Platform☆116Updated 2 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆67Updated 2 weeks ago
- My personal fork of koboldcpp where I hack in experimental samplers.☆46Updated last year
- ☆80Updated 4 months ago
- ☆107Updated 2 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆111Updated this week
- ☆206Updated 2 months ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆56Updated 8 months ago
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆222Updated last month
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆257Updated 4 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆319Updated 4 months ago
- Writing Extension for Text Generation WebUI☆63Updated 6 months ago
- ☆49Updated 4 months ago
- Automated speech dataset creator☆155Updated last month
- Completely local data-management platform with built in trainable recommendation engine☆215Updated 2 weeks ago
- ☆204Updated last month
- Memoir+ a persona memory extension for Text Gen Web UI.☆207Updated last week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆209Updated 4 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 3 months ago