HabanaAI / Megatron-DeepSpeedLinks
Intel Gaudi's Megatron DeepSpeed Large Language Models for training
☆15Updated 11 months ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below
Sorting:
- ☆71Updated 8 months ago
- Unit Scaling demo and experimentation code☆16Updated last year
- ☆27Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆122Updated last year
- ☆113Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆70Updated last month
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆63Updated last month
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆133Updated last year
- ☆58Updated 2 years ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Updated last week
- pytorch code examples for measuring the performance of collective communication calls in AI workloads☆18Updated 2 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆86Updated last year
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆63Updated 5 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆90Updated 2 months ago
- extensible collectives library in triton☆91Updated 8 months ago
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆118Updated last year
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆169Updated 2 months ago
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆149Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated 2 weeks ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- vLLM performance dashboard☆39Updated last year
- Make triton easier☆49Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- LLM-Inference-Bench☆57Updated 4 months ago
- ☆14Updated last month
- Ship correct and fast LLM kernels to PyTorch☆125Updated 3 weeks ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated last week
- ☆78Updated last year
- QuIP quantization☆61Updated last year