Estimate MFU for DeepSeekV3
☆26Jan 5, 2025Updated last year
Alternatives and similar repositories for DPSKV3MFU
Users that are interested in DPSKV3MFU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Transformers components but in Triton☆34May 9, 2025Updated last year
- ☆13Dec 9, 2024Updated last year
- ☆13Jun 18, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- ☆10Oct 22, 2026Updated last week
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆26Aug 5, 2026Updated 2 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- Ongoing research training transformer models at scale☆19Updated this week
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ☆19Aug 16, 2025Updated last year
- ☆65Apr 26, 2025Updated last year
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- ☆125May 19, 2025Updated last year
- ☆14Sep 22, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Triton-based Symmetric Memory operators and examples☆113May 15, 2026Updated 5 months ago
- Flash-Linear-Attention models beyond language☆21Aug 28, 2025Updated last year
- ☆137Nov 11, 2024Updated last year
- The repository for ATC'25 paper "Greyhound: Hunting Fail-Slows in Hybrid-Parallel Training at Scale"☆17Sep 7, 2026Updated last month
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- ☆27Dec 18, 2024Updated last year
- The official repository of the Omni-MATH benchmark.☆92Dec 22, 2024Updated last year
- Caffe 源码注释☆14Aug 15, 2017Updated 9 years ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A Top-Down Profiler for GPU Applications☆24Feb 29, 2024Updated 2 years ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆301Sep 25, 2026Updated last month
- Pipeline Parallelism Emulation and Visualization☆84Jun 30, 2026Updated 4 months ago
- ☆40Dec 14, 2025Updated 10 months ago
- ☆46Oct 15, 2025Updated last year
- ☆17May 10, 2024Updated 2 years ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆94Oct 30, 2024Updated last year