sasha0552 / nvidia-pstatedLinks
A daemon that automatically manages the performance states of NVIDIA GPUs.
☆95Updated 2 weeks ago
Alternatives and similar repositories for nvidia-pstated
Users that are interested in nvidia-pstated are comparing it to the libraries listed below
Sorting:
- GPU Power and Performance Manager☆61Updated 11 months ago
- ☆83Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆513Updated last week
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆29Updated last year
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆233Updated 2 months ago
- ☆225Updated 5 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆23Updated last year
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆28Updated 4 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS over OpenAI endpoints.☆211Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,061Updated this week
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆76Updated 11 months ago
- LLM Frontend in a single html file☆647Updated 8 months ago
- Web UI for ExLlamaV2☆510Updated 8 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- Next-generation AI roleplay system☆240Updated last month
- Y'all thought the dead internet theory wasn't real, but HERE IT IS☆203Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆175Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆259Updated 7 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆147Updated this week
- ☆83Updated 7 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆339Updated 7 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 6 months ago
- Efforts toward giving Qwen 3 Coder 30B A3B proper agentic tool calling capabilities at or near 100% reliability.☆60Updated 2 months ago
- A open webui function for better R1 experience☆78Updated 7 months ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆57Updated 11 months ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆58Updated this week
- Easy to use interface for the Whisper model optimized for all GPUs!☆320Updated 2 months ago
- InferX: Inference as a Service Platform☆136Updated this week
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆163Updated last year
- A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.☆204Updated 5 months ago