huggingface / optimum-amdLinks
AMD related optimizations for transformer models
☆79Updated 7 months ago
Alternatives and similar repositories for optimum-amd
Users that are interested in optimum-amd are comparing it to the libraries listed below
Sorting:
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆87Updated this week
- Fast and memory-efficient exact attention☆174Updated this week
- ☆68Updated this week
- Inference server benchmarking tool☆74Updated 2 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆129Updated this week
- ☆137Updated this week
- Repository for CPU Kernel Generation for LLM Inference☆26Updated last year
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated 9 months ago
- python package of rocm-smi-lib☆21Updated 9 months ago
- QuIP quantization☆54Updated last year
- ☆158Updated last week
- ☆72Updated 3 months ago
- No-code CLI designed for accelerating ONNX workflows☆198Updated 2 weeks ago
- Ahead of Time (AOT) Triton Math Library☆66Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆264Updated 8 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- LLM training in simple, raw C/HIP for AMD GPUs☆49Updated 9 months ago
- ☆74Updated 7 months ago
- Google TPU optimizations for transformers models☆113Updated 5 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆304Updated 3 weeks ago
- ☆118Updated last year
- KV cache compression for high-throughput LLM inference☆131Updated 4 months ago
- ☆108Updated last week
- A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.☆172Updated 2 months ago
- Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…☆66Updated this week
- 👷 Build compute kernels☆68Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆188Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆106Updated this week
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated last week
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆252Updated 7 months ago