Alternatives and similar repositories for bitsandbytes-rocm

Users that are interested in bitsandbytes-rocm are comparing it to the libraries listed below

• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆53Updated this week
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆174Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• WapaMario63 / GPTQ-for-LLaMa-ROCm
  4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.
  ☆32Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆79Updated 7 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated last year
• AlpinDale / RPTQ-for-LLaMA
  Efficient 3bit/4bit quantization of LLaMA models
  ☆19Updated 2 years ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆46Updated 3 months ago
• evshiron / rocm_lab
  DEPRECATED!
  ☆52Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆126Updated 2 years ago
• broncotc / bitsandbytes-rocm
  ☆37Updated 2 years ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆502Updated 4 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆177Updated this week
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆162Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆205Updated 4 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆125Updated this week
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆72Updated 8 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆408Updated last week
• amd / fuzzyHSA
  ☆54Updated last year
• Cornell-RelaxML / qtip
  ☆137Updated this week
• Abel2076 / json2binidx_tool
  ☆82Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year