Alternatives and similar repositories for gddr6

Users that are interested in gddr6 are comparing it to the libraries listed below

• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆54Updated 5 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆60Updated last week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆193Updated last week
• xor2k / gpu_undervolt
  ☆42Updated 2 years ago
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• ReinForce-II / mmapeak
  ☆43Updated 2 weeks ago
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆126Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆212Updated this week
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆63Updated 3 weeks ago
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆23Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• lamikr / rocm_sdk_builder
  ☆404Updated 6 months ago
• Cornell-RelaxML / qtip
  ☆152Updated 3 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆532Updated this week
• sekstini / gpupoor
  ☆17Updated 10 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆69Updated 8 months ago
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆56Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆90Updated last month
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆288Updated last year
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated last year
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 8 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆59Updated last year
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆450Updated last week
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆96Updated 3 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆90Updated last week
• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆1,260Updated 4 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆60Updated 4 months ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆70Updated 2 years ago