Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
☆78Aug 12, 2025Updated last year
Alternatives and similar repositories for GPUs-Specs
Users that are interested in GPUs-Specs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- High-Throughput Batch Inference☆18Updated this week
- [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation☆28Jul 11, 2026Updated 3 months ago
- A simple calculation for LLM MFU.☆78Sep 10, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distributed Compiler and Optimized Parallel Kernels☆1,577Sep 18, 2026Updated last month
- Megakernel for Gated DeltaNet, optimized by PTO-ISA☆23Oct 19, 2026Updated last week
- Cluster simulator with far memory☆12Apr 28, 2020Updated 6 years ago
- 🎓Automatically Update LLM inference systems Papers Daily using Github Actions (Update Every 12th hours)☆12Updated this week
- ☆16Feb 11, 2025Updated last year
- Code for paper "Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI"☆13Jan 19, 2024Updated 2 years ago
- ☆14Oct 3, 2024Updated 2 years ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆37May 22, 2026Updated 5 months ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆25May 25, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆26Aug 5, 2026Updated 2 months ago
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆33May 12, 2026Updated 5 months ago
- repository for the MICCAI 2022 AutoPET challenge☆14Sep 19, 2022Updated 4 years ago
- ☆12Dec 17, 2023Updated 2 years ago
- ☆16Jul 19, 2026Updated 3 months ago
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 3 years ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆126Mar 13, 2024Updated 2 years ago
- ☆16Jul 28, 2021Updated 5 years ago
- GPU TopK Benchmark☆18Dec 19, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆103May 14, 2026Updated 5 months ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆55Jul 3, 2022Updated 4 years ago
- Disaggregated serving system for Large Language Models (LLMs).☆846Apr 6, 2025Updated last year
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,376Aug 28, 2025Updated last year
- study of Ampere' Sparse Matmul☆18Jan 10, 2021Updated 5 years ago
- ☆34Jul 13, 2026Updated 3 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆158May 10, 2025Updated last year
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆689Sep 11, 2024Updated 2 years ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆33Apr 9, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,880Sep 24, 2026Updated last month
- Examples of CUDA implementations by Cutlass CuTe☆283Jul 1, 2025Updated last year
- Code for "Fast Sparse ConvNets" CVPR2020 submissions☆12Nov 20, 2019Updated 6 years ago
- ☆14Jul 22, 2026Updated 3 months ago
- FlashMob is a shared-memory random walk system.☆33Jul 7, 2023Updated 3 years ago
- Cycle-accurate C++ & SystemC simulator for the RISC-V GPGPU Ventus☆36May 17, 2026Updated 5 months ago
- ☆99Apr 2, 2025Updated last year