huggingface / optimum-habanaLinks
Easy and lightning fast training of ๐ค Transformers on Habana Gaudi processor (HPU)
โ193Updated this week
Alternatives and similar repositories for optimum-habana
Users that are interested in optimum-habana are comparing it to the libraries listed below
Sorting:
- ๐๏ธ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Oโฆโ310Updated this week
- Large Language Model Text Generation Inference on Habana Gaudiโ34Updated 5 months ago
- ๐ค Optimum Intel: Accelerate inference with Intel optimization toolsโ485Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMsโ266Updated 10 months ago
- Reference models for Intel(R) Gaudi(R) AI Acceleratorโ167Updated 2 weeks ago
- Easy and Efficient Quantization for Transformersโ201Updated 2 months ago
- ๐ Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.โ208Updated last week
- A tool to configure, launch and manage your machine learning experiments.โ183Updated this week
- An innovative library for efficient LLM inference via low-bit quantizationโ349Updated 11 months ago
- Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.โ507Updated 4 months ago
- โ120Updated last year
- Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.โ103Updated last year
- GPTQ inference Triton kernelโ306Updated 2 years ago
- ๐ Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flashโฆโ261Updated last month
- Intelยฎ Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Noteโฆโ62Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMsโ80Updated this week
- The Triton backend for the ONNX Runtime.โ159Updated 2 weeks ago
- Blazing fast training of ๐ค Transformers on Graphcore IPUsโ86Updated last year
- Google TPU optimizations for transformers modelsโ118Updated 7 months ago
- Benchmark suite for LLMs from Fireworks.aiโ80Updated 3 weeks ago
- Applied AI experiments and examples for PyTorchโ291Updated this week
- โ289Updated 3 weeks ago
- OpenAI compatible API for TensorRT LLM triton backendโ214Updated last year
- โ217Updated 7 months ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welโฆโ369Updated 2 months ago
- Fast low-bit matmul kernels in Tritonโ349Updated last week
- A safetensors extension to efficiently store sparse quantized tensors on diskโ153Updated this week
- โ251Updated last year
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.โ886Updated 11 months ago
- Pipeline Parallelism for PyTorchโ774Updated last year