Alternatives and similar repositories for gddr6:

Users that are interested in gddr6 are comparing it to the libraries listed below

• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆39Updated 4 months ago
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆20Updated 6 months ago
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated last year
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆52Updated last year
• xor2k / gpu_undervolt
  ☆41Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆305Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆38Updated this week
• lamikr / rocm_sdk_builder
  ☆296Updated 2 weeks ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆48Updated 2 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 7 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆171Updated this week
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆16Updated last month
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆150Updated 11 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆59Updated 2 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆45Updated 11 months ago
• broncotc / bitsandbytes-rocm
  ☆37Updated last year
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆189Updated last year
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆38Updated 7 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆292Updated this week
• artyom-beilis / dlprimitives
  Deep Learning Primitives and Mini-Framework for OpenCL
  ☆192Updated 7 months ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• arlo-phoenix / CTranslate2-rocm
  Fast inference engine for Transformer models
  ☆31Updated 5 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 6 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆24Updated 3 weeks ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆102Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆137Updated 3 weeks ago