Alternatives and similar repositories for gddr6

Users that are interested in gddr6 are comparing it to the libraries listed below

• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆53Updated 3 weeks ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆25Updated last month
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆47Updated 2 months ago
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆177Updated this week
• xor2k / gpu_undervolt
  ☆42Updated 2 years ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆436Updated this week
• lamikr / rocm_sdk_builder
  ☆356Updated 3 months ago
• Cornell-RelaxML / qtip
  ☆139Updated 3 weeks ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 4 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆156Updated last year
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆234Updated this week
• ROCm / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆12Updated last year
• KONAKONA666 / q8_kernels
  ☆71Updated 6 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆43Updated 10 months ago
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆43Updated 2 months ago
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆115Updated 2 years ago
• xuhuisheng / rocm-gfx803
  ☆233Updated 2 years ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆153Updated 9 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆652Updated this week
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆21Updated 9 months ago
• ReinForce-II / mmapeak
  ☆31Updated 3 months ago
• sekstini / gpupoor
  ☆17Updated 7 months ago
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆54Updated last year
• broncotc / bitsandbytes-rocm
  ☆37Updated 2 years ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 10 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆63Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year