jjziets / gddr6_tempsLinks
Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
☆23Updated 11 months ago
Alternatives and similar repositories for gddr6_temps
Users that are interested in gddr6_temps are comparing it to the libraries listed below
Sorting:
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆53Updated 4 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆74Updated 10 months ago
- llama-swap + a minimal ollama compatible api☆24Updated this week
- ☆83Updated this week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆82Updated this week
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆27Updated 4 months ago
- Writing Extension for Text Generation WebUI☆63Updated last month
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 5 months ago
- ☆20Updated 11 months ago
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆164Updated last year
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆232Updated last month
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆136Updated this week
- GPU Power and Performance Manager☆61Updated 11 months ago
- Lightweight Inference server for OpenVINO☆211Updated this week
- Neo AI integrates into the Linux terminal, capable of executing system commands and providing helpful information.☆113Updated 4 months ago
- A fast batching API to serve LLM models☆187Updated last year
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆96Updated 3 weeks ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆185Updated last year
- ☆82Updated 6 months ago
- An OpenAI API compatible images server to generate or manipulate images.☆17Updated 7 months ago
- InferX is a Inference Function as a Service Platform☆133Updated this week
- Easily view and modify JSON datasets for large language models☆82Updated 4 months ago
- ☆50Updated 7 months ago
- ☆100Updated 3 weeks ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆57Updated 10 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated 11 months ago
- A frontend for creative writing with LLMs☆134Updated last year
- AI management tool☆121Updated 10 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆493Updated this week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆164Updated last year