sasha0552 / nvidia-pstatedLinks
A daemon that automatically manages the performance states of NVIDIA GPUs.
☆100Updated 3 weeks ago
Alternatives and similar repositories for nvidia-pstated
Users that are interested in nvidia-pstated are comparing it to the libraries listed below
Sorting:
- GPU Power and Performance Manager☆61Updated last year
- ☆228Updated 6 months ago
- ☆86Updated last week
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆31Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆586Updated this week
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆29Updated 6 months ago
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆236Updated last month
- Web UI for ExLlamaV2☆514Updated 9 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆24Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆176Updated last year
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆247Updated 3 weeks ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆79Updated last week
- Y'all thought the dead internet theory wasn't real, but HERE IT IS☆208Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆167Updated last year
- Manifold is a platform for enabling workflow automation using AI assistants.☆464Updated last week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆84Updated this week
- A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…☆74Updated last year
- LLM Frontend in a single html file☆665Updated last week
- ☆51Updated 9 months ago
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆59Updated last month
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆266Updated 8 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆68Updated 7 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆154Updated this week
- Memoir+ a persona memory extension for Text Gen Web UI.☆221Updated last week
- InferX: Inference as a Service Platform☆139Updated this week
- Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…☆65Updated last week
- ☆83Updated 9 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,341Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆21Updated last week