Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
☆78Aug 12, 2025Updated last year
Alternatives and similar repositories for GPUs-Specs
Users that are interested in GPUs-Specs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- A simple calculation for LLM MFU.☆78Sep 10, 2025Updated last year
- [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation☆29Jul 11, 2026Updated 4 months ago
- High-Throughput Batch Inference☆22Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Distributed Compiler and Optimized Parallel Kernels☆1,587Updated this week
- Cluster simulator with far memory☆12Apr 28, 2020Updated 6 years ago
- Code for paper "Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI"☆13Jan 19, 2024Updated 2 years ago
- ☆16Feb 11, 2025Updated last year
- ☆14Oct 3, 2024Updated 2 years ago
- cuda best practice & notes☆10Oct 24, 2025Updated last year
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆38May 22, 2026Updated 6 months ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆25May 25, 2026Updated 5 months ago
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆33May 12, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🎓Automatically Update LLM inference systems Papers Daily using Github Actions (Update Every 12th hours)☆12Updated this week
- ☆12Dec 17, 2023Updated 2 years ago
- Megakernel for Gated DeltaNet, optimized by PTO-ISA☆25Oct 19, 2026Updated last month
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 3 years ago
- ☆18Jul 19, 2026Updated 4 months ago
- ☆16Jul 28, 2021Updated 5 years ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆28Aug 5, 2026Updated 3 months ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆285Mar 6, 2025Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆126Mar 13, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GPU TopK Benchmark☆18Dec 19, 2024Updated last year
- repository for the MICCAI 2022 AutoPET challenge☆14Sep 19, 2022Updated 4 years ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆55Jul 3, 2022Updated 4 years ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,379Aug 28, 2025Updated last year
- study of Ampere' Sparse Matmul☆18Jan 10, 2021Updated 5 years ago
- Disaggregated serving system for Large Language Models (LLMs).☆847Apr 6, 2025Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆158May 10, 2025Updated last year
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆117Nov 3, 2026Updated 2 weeks ago
- ☆34Jul 13, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DB, OCR, Pytorch, 文本检测算法,A PyToch implementation of "Real-time Scene Text Detection with Differentiable Binarization".☆11Dec 16, 2020Updated 5 years ago
- Examples of CUDA implementations by Cutlass CuTe☆284Jul 1, 2025Updated last year
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆693Sep 11, 2024Updated 2 years ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,906Sep 24, 2026Updated last month
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆33Apr 9, 2023Updated 3 years ago
- ☆14Jul 22, 2026Updated 4 months ago
- ☆99Apr 2, 2025Updated last year
Are these results useful?