Alternatives and similar repositories for gddr6

Users that are interested in gddr6 are comparing it to the libraries listed below

• xor2k / gpu_undervolt
  ☆49Updated 2 years ago
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated 2 years ago
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆126Updated last month
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆69Updated 3 months ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆70Updated 4 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆622Updated this week
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆56Updated 2 years ago
• lamikr / rocm_sdk_builder
  ☆426Updated 9 months ago
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆24Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆213Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆47Updated 9 months ago
• United-Compute / gpu-benchmark
  Benchmark your GPU with ease
  ☆28Updated last month
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated 2 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆74Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆97Updated 3 months ago
• ReinForce-II / mmapeak
  ☆51Updated last month
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆110Updated 2 months ago
• xuhuisheng / rocm-gfx803
  ☆237Updated 2 years ago
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆138Updated 2 years ago
• Cornell-RelaxML / qtip
  ☆163Updated 7 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆352Updated last year
• arlo-phoenix / CTranslate2-rocm
  Fast inference engine for Transformer models
  ☆55Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated 2 years ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆759Updated this week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆127Updated last year