intelligent-machine-learning / atorch
An industrial extension library of pytorch to accelerate large scale model training
☆32Updated 2 months ago
Alternatives and similar repositories for atorch:
Users that are interested in atorch are comparing it to the libraries listed below
- ☆131Updated last month
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆116Updated 2 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆120Updated 3 months ago
- ☆139Updated last year
- ☆92Updated 7 months ago
- ☆127Updated 4 months ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆97Updated last year
- An easy-to-use package for implementing SmoothQuant for LLMs☆96Updated 2 weeks ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆47Updated 9 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆68Updated 10 months ago
- A collection of memory efficient attention operators implemented in the Triton language.☆262Updated 10 months ago
- ☆69Updated last week
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆184Updated last week
- nnScaler: Compiling DNN models for Parallel Training☆107Updated last week
- Benchmark code for the "Online normalizer calculation for softmax" paper☆91Updated 6 years ago
- Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆120Updated 3 weeks ago
- ☆82Updated 3 weeks ago
- Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training☆209Updated 8 months ago
- ☆48Updated this week
- Zero Bubble Pipeline Parallelism☆383Updated 2 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆81Updated 5 months ago
- A low-latency & high-throughput serving engine for LLMs☆346Updated last week
- High performance Transformer implementation in C++.☆118Updated 3 months ago
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆52Updated 8 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆268Updated this week
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆197Updated 3 weeks ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆246Updated last month
- Transformer related optimization, including BERT, GPT☆59Updated last year
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆236Updated last week
- ☆148Updated 3 months ago