huggingface / optimum-habanaLinks
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
☆194Updated this week
Alternatives and similar repositories for optimum-habana
Users that are interested in optimum-habana are comparing it to the libraries listed below
Sorting:
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆315Updated this week
- Large Language Model Text Generation Inference on Habana Gaudi☆34Updated 5 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆167Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated 11 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆489Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆190Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆374Updated 3 months ago
- Easy and Efficient Quantization for Transformers☆203Updated 2 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆209Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆348Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆265Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆83Updated this week
- GPTQ inference Triton kernel☆307Updated 2 years ago
- ☆294Updated last month
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆62Updated 2 months ago
- Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.☆509Updated 4 months ago
- ☆252Updated last year
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆86Updated last year
- Google TPU optimizations for transformers models☆120Updated 7 months ago
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆100Updated this week
- ☆217Updated 7 months ago
- Pipeline Parallelism for PyTorch☆779Updated last year
- Inference server benchmarking tool☆98Updated 4 months ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆89Updated this week
- ☆121Updated last year
- Applied AI experiments and examples for PyTorch☆295Updated 3 weeks ago
- Fast low-bit matmul kernels in Triton☆365Updated this week
- ☆197Updated 4 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆395Updated 2 weeks ago
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆895Updated last year