Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.
☆22Apr 16, 2026Updated 5 months ago
Alternatives and similar repositories for LLM-para
Users that are interested in LLM-para are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Apr 15, 2025Updated last year
- Verilog-Based-NoC-Simulator☆12May 4, 2016Updated 10 years ago
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆118Apr 26, 2025Updated last year
- ☆45Sep 2, 2026Updated 2 weeks ago
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Apr 16, 2023Updated 3 years ago
- ☆42Jun 25, 2026Updated 2 months ago
- Instruction Pointer Classifier and Dynamic Degree Stream based Hardware Cache Prefetching☆16Nov 16, 2019Updated 6 years ago
- CoralNPU behavior simulator based on MPACT-Sim☆27Jun 10, 2026Updated 3 months ago
- A skill for automatically optimizing CUDA code.☆43Mar 26, 2026Updated 5 months ago
- ☆17Mar 29, 2026Updated 5 months ago
- Official codebase for the MLSys 2026 paper "IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference". It enables hi…☆21May 29, 2026Updated 3 months ago
- 训练营讲义☆21Jan 21, 2025Updated last year
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆19Mar 30, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An Open-Source Scaling Framework for Domain Specific Architectures☆63Updated this week
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆20May 20, 2026Updated 3 months ago
- ☆12Mar 26, 2024Updated 2 years ago
- [ASPLOS'26] HILOS: A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs☆22Jan 18, 2026Updated 8 months ago
- ☆14Dec 20, 2024Updated last year
- Fast SHA-256 that utilizes the GPU☆13Dec 17, 2021Updated 4 years ago
- ☆15Jan 21, 2023Updated 3 years ago
- Orchestrating many small GPU clusters for running serverless GPU workloads☆18Mar 15, 2026Updated 6 months ago
- ☆18May 28, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An accelerator for high-dimensional approximate nearest neighbor search☆15May 17, 2025Updated last year
- Source code of the paper "OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs"☆16Aug 23, 2022Updated 4 years ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- ☆15May 8, 2025Updated last year
- ☆124Nov 17, 2023Updated 2 years ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆28Sep 2, 2025Updated last year
- ☆28Aug 18, 2019Updated 7 years ago
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆13Feb 3, 2025Updated last year
- vLLM Router☆59Mar 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆34Jul 4, 2024Updated 2 years ago
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- Simple example of how to write an Implicit GEMM Convolution in CUDA using the tensor core WMMA API and bindings for PyTorch.☆19Jun 29, 2023Updated 3 years ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 9 years ago
- XuanTie vendor extension Instruction Set spec☆47Sep 7, 2026Updated last week
- EDA toolchain for processing-in-memory architectures, including an architecture synthesizer, a compiler, and a simulator☆28Jun 12, 2025Updated last year