HabanaAI / Megatron-DeepSpeedLinks
Intel Gaudi's Megatron DeepSpeed Large Language Models for training
☆18Updated last year
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below
Sorting:
- ☆71Updated 10 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆64Updated 7 months ago
- ☆61Updated 2 years ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆93Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆125Updated last year
- Quantize transformers to any learned arbitrary 4-bit numeric format☆50Updated 2 weeks ago
- ☆27Updated 2 years ago
- python package of rocm-smi-lib☆24Updated last month
- Unit Scaling demo and experimentation code☆16Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- LM engine is a library for pretraining/finetuning LLMs☆113Updated this week
- vLLM performance dashboard☆41Updated last year
- LLM-Inference-Bench☆58Updated 6 months ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆69Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆70Updated 2 months ago
- Distributed preprocessing and data loading for language datasets☆40Updated last year
- Large Language Model Text Generation Inference on Habana Gaudi☆34Updated 10 months ago
- ☆79Updated last year
- vLLM adapter for a TGIS-compatible gRPC server.☆50Updated this week
- LLM checkpointing for DeepSpeed/Megatron☆24Updated 2 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Updated last month
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Updated last week
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆141Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated 2 years ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 6 months ago
- Accepted to MLSys 2026☆70Updated last week
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆220Updated last week
- ☆115Updated last year
- extensible collectives library in triton☆95Updated 10 months ago
- Fast and memory-efficient exact attention☆111Updated last week