CalvinXKY / mfu_calculationLinks
A simple calculation for LLM MFU.
☆48Updated last month
Alternatives and similar repositories for mfu_calculation
Users that are interested in mfu_calculation are comparing it to the libraries listed below
Sorting:
- Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)☆62Updated last month
- ☆78Updated 6 months ago
- DeeperGEMM: crazy optimized version☆72Updated 5 months ago
- ☆65Updated 6 months ago
- ☆148Updated 7 months ago
- Allow torch tensor memory to be released and resumed later☆150Updated last week
- Toolchain built around the Megatron-LM for Distributed Training☆67Updated last week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆70Updated last week
- ☆50Updated 5 months ago
- ☆97Updated 7 months ago
- Estimate MFU for DeepSeekV3☆26Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆125Updated 4 months ago
- ☆43Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Updated 2 months ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆60Updated 11 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆156Updated 2 weeks ago
- ☆39Updated 2 months ago
- ☆100Updated last year
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆61Updated 3 weeks ago
- GPTQ inference TVM kernel☆39Updated last year
- Odysseus: Playground of LLM Sequence Parallelism☆78Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆139Updated last month
- ☆18Updated 2 weeks ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆80Updated 11 months ago
- A lightweight design for computation-communication overlap.☆181Updated 2 weeks ago
- ☆87Updated 3 years ago
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆66Updated last year
- JAX backend for SGL☆78Updated this week
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆50Updated last year
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆120Updated 6 months ago