HabanaAI / Megatron-DeepSpeedLinks
Intel Gaudi's Megatron DeepSpeed Large Language Models for training
☆18Updated last year
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below
Sorting:
- ☆71Updated 10 months ago
- ☆27Updated 2 years ago
- ☆61Updated 2 years ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆64Updated 7 months ago
- LLM-Inference-Bench☆58Updated 6 months ago
- Distributed preprocessing and data loading for language datasets☆40Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆125Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆70Updated 3 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 6 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆93Updated last year
- ☆79Updated last year
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆141Updated last year
- ☆115Updated last year
- Large Language Model Text Generation Inference on Habana Gaudi☆34Updated 10 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆142Updated 8 months ago
- Ship correct and fast LLM kernels to PyTorch☆140Updated 3 weeks ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆93Updated this week
- Accepted to MLSys 2026☆70Updated last week
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆55Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆113Updated this week
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆120Updated last year
- extensible collectives library in triton☆95Updated 10 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated 2 years ago
- Framework to reduce autotune overhead to zero for well known deployments.☆96Updated 4 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆219Updated last week
- Fast and memory-efficient exact attention☆111Updated last week
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆27Updated last year
- Elixir: Train a Large Language Model on a Small GPU Cluster☆15Updated 2 years ago
- Linear Attention Sequence Parallelism (LASP)☆88Updated last year
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Updated last month