huggingface / optimum-habanaLinks
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
☆204Updated this week
Alternatives and similar repositories for optimum-habana
Users that are interested in optimum-habana are comparing it to the libraries listed below
Sorting:
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆325Updated 3 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Updated 9 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆527Updated this week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆169Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆268Updated last month
- Module, Model, and Tensor Serialization/Deserialization☆283Updated 4 months ago
- The Triton backend for the PyTorch TorchScript models.☆170Updated this week
- Easy and Efficient Quantization for Transformers☆202Updated 6 months ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆86Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆85Updated this week
- Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.☆106Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆218Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆213Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆351Updated last year
- The Triton backend for the ONNX Runtime.☆170Updated this week
- Google TPU optimizations for transformers models☆133Updated 3 weeks ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆63Updated 6 months ago
- ☆123Updated last year
- Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.☆510Updated 8 months ago
- GPTQ inference Triton kernel☆316Updated 2 years ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆398Updated this week
- ☆252Updated last year
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆502Updated last week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆411Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆277Updated last month
- Pipeline Parallelism for PyTorch☆783Updated last year
- Applied AI experiments and examples for PyTorch☆312Updated 4 months ago
- Benchmark suite for LLMs from Fireworks.ai☆84Updated last month
- ☆322Updated this week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆228Updated this week