huggingface / optimum-habana
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
☆181Updated this week
Alternatives and similar repositories for optimum-habana:
Users that are interested in optimum-habana are comparing it to the libraries listed below
- Large Language Model Text Generation Inference on Habana Gaudi☆32Updated 2 weeks ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆290Updated 2 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆456Updated this week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆162Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆62Updated this week
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆84Updated last year
- ☆238Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆262Updated 5 months ago
- Applied AI experiments and examples for PyTorch☆251Updated last week
- Fast low-bit matmul kernels in Triton☆275Updated this week
- Easy and Efficient Quantization for Transformers☆195Updated last month
- Google TPU optimizations for transformers models☆104Updated 2 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆62Updated 3 weeks ago
- This repository contains the experimental PyTorch native float8 training UX☆222Updated 8 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆190Updated this week
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆87Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆133Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆351Updated 7 months ago
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆783Updated 6 months ago
- ☆116Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆234Updated this week
- ☆63Updated last week
- OpenAI compatible API for TensorRT LLM triton backend☆202Updated 8 months ago
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆90Updated this week
- Advanced Quantization Algorithm for LLMs/VLMs.☆413Updated this week
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆123Updated last week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆155Updated 3 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆131Updated last week
- ☆184Updated 6 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆243Updated 5 months ago