InternLM / Awesome-LLM-Training-System
☆29Updated 7 months ago
Alternatives and similar repositories for Awesome-LLM-Training-System:
Users that are interested in Awesome-LLM-Training-System are comparing it to the libraries listed below
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆51Updated 7 months ago
- ☆87Updated 4 months ago
- High performance Transformer implementation in C++.☆105Updated last month
- ☆80Updated 2 years ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆25Updated this week
- ☆74Updated 3 months ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆230Updated last week
- ☆87Updated 6 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆78Updated 3 months ago
- ☆52Updated 11 months ago
- Summary of some awesome work for optimizing LLM inference☆63Updated this week
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆148Updated 8 months ago
- Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.☆60Updated last year
- ☆120Updated last week
- ☆72Updated 3 years ago
- Implement Flash Attention using Cute.☆71Updated 2 months ago
- nnScaler: Compiling DNN models for Parallel Training☆101Updated last month
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆201Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆70Updated 4 months ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆41Updated 4 months ago
- ATC23 AE☆45Updated last year
- 16-fold memory access reduction with nearly no loss☆80Updated 3 weeks ago
- A sparse attention kernel supporting mix sparse patterns☆161Updated last month
- ☆63Updated 3 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆149Updated 5 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆60Updated 9 months ago
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆253Updated 3 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆59Updated last week
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆93Updated last year
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆17Updated last year