sasha0552 / nvidia-pstatedLinks
A daemon that automatically manages the performance states of NVIDIA GPUs.
☆104Updated 2 months ago
Alternatives and similar repositories for nvidia-pstated
Users that are interested in nvidia-pstated are comparing it to the libraries listed below
Sorting:
- GPU Power and Performance Manager☆64Updated last year
- ☆87Updated last month
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆31Updated last year
- ☆229Updated 8 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆79Updated last month
- Y'all thought the dead internet theory wasn't real, but HERE IT IS☆208Updated last year
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆239Updated 2 months ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆29Updated 7 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆24Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆177Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆616Updated this week
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆270Updated last week
- ☆83Updated 10 months ago
- Web UI for ExLlamaV2☆514Updated 11 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆346Updated 10 months ago
- A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…☆44Updated 2 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆76Updated this week
- A tool to determine whether or not your PC can run a given LLM☆166Updated 11 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆68Updated 9 months ago
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆64Updated 2 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆216Updated last month
- An AI assistant beyond the chat box.☆328Updated last year
- ☆48Updated 2 years ago
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆475Updated this week
- Memoir+ a persona memory extension for Text Gen Web UI.☆223Updated last week
- Stable Diffusion and Flux in pure C/C++☆24Updated this week
- Convert downloaded Ollama models back into their GGUF equivalent format☆66Updated last year
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆154Updated last week
- Next-generation AI roleplay system☆293Updated 3 weeks ago