hpcaitech / ColossalAI-BenchmarkLinks
Performance benchmarking with ColossalAI
☆39Updated 2 years ago
Alternatives and similar repositories for ColossalAI-Benchmark
Users that are interested in ColossalAI-Benchmark are comparing it to the libraries listed below
Sorting:
- A Python library transfers PyTorch tensors between CPU and NVMe☆116Updated 6 months ago
- Scalable PaLM implementation of PyTorch☆189Updated 2 years ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 6 months ago
- Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training☆210Updated 9 months ago
- ☆74Updated 4 years ago
- PyTorch bindings for CUTLASS grouped GEMM.☆125Updated 5 months ago
- ☆27Updated 3 years ago
- Sky Computing: Accelerating Geo-distributed Computing in Federated Learning☆91Updated 2 years ago
- ☆79Updated 3 weeks ago
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆63Updated 2 months ago
- ☆105Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆93Updated last week
- ☆146Updated 10 months ago
- nnScaler: Compiling DNN models for Parallel Training☆114Updated this week
- ☆30Updated last year
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆55Updated 10 months ago
- ATC23 AE☆45Updated 2 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆211Updated last year
- A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …☆112Updated last year
- A collection of memory efficient attention operators implemented in the Triton language.☆271Updated last year
- Sequence-level 1F1B schedule for LLMs.☆17Updated last year
- This repository contains integer operators on GPUs for PyTorch.☆205Updated last year
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆251Updated 7 months ago
- ☆84Updated 3 years ago
- ☆208Updated 10 months ago
- ☆42Updated 2 years ago
- Odysseus: Playground of LLM Sequence Parallelism☆69Updated 11 months ago
- ☆96Updated 8 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆37Updated 3 months ago
- ☆157Updated last year