bytedance / ByteMLPerfLinks
AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.
☆257Updated this week
Alternatives and similar repositories for ByteMLPerf
Users that are interested in ByteMLPerf are comparing it to the libraries listed below
Sorting:
- ☆150Updated 7 months ago
- ☆140Updated last year
- ☆128Updated 7 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆104Updated 3 months ago
- A model compilation solution for various hardware☆443Updated this week
- PyTorch distributed training acceleration framework☆51Updated last week
- A lightweight design for computation-communication overlap.☆155Updated last week
- ☆84Updated last week
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆72Updated this week
- ☆130Updated 8 months ago
- Fast and memory-efficient exact attention☆87Updated last week
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆83Updated 2 years ago
- DeepSeek-V3/R1 inference performance simulator☆165Updated 4 months ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆111Updated last year
- GLake: optimizing GPU memory management and IO transmission.☆473Updated 4 months ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆95Updated 2 years ago
- ☆97Updated 11 months ago
- Yinghan's Code Sample☆344Updated 3 years ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆399Updated this week
- ☆59Updated 9 months ago
- ☆150Updated 7 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆94Updated 2 weeks ago
- Development repository for the Triton-Linalg conversion☆193Updated 6 months ago
- ☆135Updated 3 months ago
- Examples of CUDA implementations by Cutlass CuTe☆219Updated last month
- A benchmark suited especially for deep learning operators☆42Updated 2 years ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆407Updated 2 months ago
- A home for the final text of all TVM RFCs.☆105Updated 10 months ago
- Shared Middle-Layer for Triton Compilation☆268Updated last week
- ☆138Updated last year