HabanaAI / Megatron-DeepSpeedLinks
Intel Gaudi's Megatron DeepSpeed Large Language Models for training
☆16Updated last year
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below
Sorting:
- ☆71Updated 9 months ago
- ☆59Updated 2 years ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆63Updated 5 months ago
- ☆27Updated last year
- Framework to reduce autotune overhead to zero for well known deployments.☆91Updated 3 months ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆123Updated last year
- Fast and memory-efficient exact attention☆105Updated last week
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆135Updated last year
- ☆78Updated last year
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆66Updated last month
- ☆115Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆89Updated last year
- extensible collectives library in triton☆91Updated 8 months ago
- pytorch code examples for measuring the performance of collective communication calls in AI workloads☆18Updated 3 months ago
- Parallel framework for training and fine-tuning deep neural networks☆71Updated last month
- PyTorch bindings for CUTLASS grouped GEMM.☆135Updated 6 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated this week
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆253Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆174Updated last week
- Autonomous GPU Kernel Generation via Deep Agents☆192Updated last week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆169Updated 3 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated 2 weeks ago
- LLM Serving Performance Evaluation Harness☆82Updated 10 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆277Updated 5 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆64Updated last week
- MLPerf™ logging library☆37Updated last week
- QuIP quantization☆61Updated last year
- ☆122Updated last year
- Distributed preprocessing and data loading for language datasets☆40Updated last year
- ☆99Updated last year