Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.
☆21Apr 16, 2026Updated 3 months ago
Alternatives and similar repositories for LLM-para
Users that are interested in LLM-para are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Apr 15, 2025Updated last year
- Verilog-Based-NoC-Simulator☆12May 4, 2016Updated 10 years ago
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆115Apr 26, 2025Updated last year
- ☆44Jul 23, 2026Updated 2 weeks ago
- ACPO: Python ML training/inference framework for LLVM optimizations☆13Jul 2, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Apr 16, 2023Updated 3 years ago
- Instruction Pointer Classifier and Dynamic Degree Stream based Hardware Cache Prefetching☆16Nov 16, 2019Updated 6 years ago
- CoralNPU behavior simulator based on MPACT-Sim☆25Jun 10, 2026Updated last month
- A skill for automatically optimizing CUDA code.☆42Mar 26, 2026Updated 4 months ago
- ☆17Mar 29, 2026Updated 4 months ago
- 训练营讲义☆21Jan 21, 2025Updated last year
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆18Mar 30, 2025Updated last year
- An Open-Source Scaling Framework for Domain Specific Architectures☆63Updated this week
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆19May 20, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆12Mar 26, 2024Updated 2 years ago
- [ASPLOS'26] HILOS: A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs☆21Jan 18, 2026Updated 6 months ago
- ☆14Dec 20, 2024Updated last year
- Fast SHA-256 that utilizes the GPU☆13Dec 17, 2021Updated 4 years ago
- ☆15Jan 21, 2023Updated 3 years ago
- Orchestrating many small GPU clusters for running serverless GPU workloads☆18Mar 15, 2026Updated 4 months ago
- ☆18May 28, 2024Updated 2 years ago
- An accelerator for high-dimensional approximate nearest neighbor search☆15May 17, 2025Updated last year
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆12Feb 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source code of the paper "OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs"☆16Aug 23, 2022Updated 3 years ago
- ☆15May 8, 2025Updated last year
- [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT.☆24Jun 24, 2026Updated last month
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- ☆15Oct 7, 2021Updated 4 years ago
- ☆124Nov 17, 2023Updated 2 years ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆28Sep 2, 2025Updated 11 months ago
- ☆28Aug 18, 2019Updated 6 years ago
- vLLM Router☆56Mar 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 9 years ago
- XuanTie vendor extension Instruction Set spec☆45Jul 3, 2026Updated last month
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆30Jun 29, 2026Updated last month
- A Cycle-accurate Microarchitecture-level NAND Flash Memory System Simulation Framework☆29Mar 20, 2013Updated 13 years ago
- [ICML2025] KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference☆30Jan 27, 2026Updated 6 months ago