CalvinXKY / mfu_calculationLinks
A simple calculation for LLM MFU.
☆46Updated 3 weeks ago
Alternatives and similar repositories for mfu_calculation
Users that are interested in mfu_calculation are comparing it to the libraries listed below
Sorting:
- Estimate MFU for DeepSeekV3☆24Updated 9 months ago
- Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)☆55Updated 3 weeks ago
- ☆147Updated 7 months ago
- ☆78Updated 5 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆130Updated last week
- ☆95Updated 6 months ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆59Updated 11 months ago
- ☆43Updated last year
- ☆64Updated 5 months ago
- ☆56Updated last year
- ☆50Updated 4 months ago
- DeeperGEMM: crazy optimized version☆71Updated 5 months ago
- Toolchain built around the Megatron-LM for Distributed Training☆67Updated last week
- ☆39Updated 2 months ago
- GPTQ inference TVM kernel☆39Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Updated 2 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆117Updated 5 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆123Updated 4 months ago
- ☆88Updated 3 years ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆80Updated 10 months ago
- 16-fold memory access reduction with nearly no loss☆105Updated 6 months ago
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆72Updated 3 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆77Updated last year
- ☆98Updated last year
- A lightweight design for computation-communication overlap.☆177Updated 2 weeks ago
- Implement Flash Attention using Cute.☆96Updated 9 months ago
- Allow torch tensor memory to be released and resumed later☆144Updated this week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆66Updated last week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆132Updated 2 weeks ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆50Updated last year