Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.
☆21Apr 16, 2026Updated 3 months ago
Alternatives and similar repositories for LLM-para
Users that are interested in LLM-para are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆40Jun 25, 2026Updated 3 weeks ago
- Verilog-Based-NoC-Simulator☆12May 4, 2016Updated 10 years ago
- ☆43Updated this week
- ACPO: Python ML training/inference framework for LLVM optimizations☆13Jul 2, 2025Updated last year
- ☆11Apr 16, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆34Jul 4, 2024Updated 2 years ago
- 3D-FPIM: An Extreme Energy-Efficient DNN Acceleration System Using 3D NAND Flash-Based In-Situ PIM Unit (MICRO 2022)☆26May 19, 2023Updated 3 years ago
- ☆15Sep 30, 2023Updated 2 years ago
- 训练营讲义☆21Jan 21, 2025Updated last year
- A skill for automatically optimizing CUDA code.☆42Mar 26, 2026Updated 3 months ago
- Instruction Pointer Classifier and Dynamic Degree Stream based Hardware Cache Prefetching☆16Nov 16, 2019Updated 6 years ago
- ☆15May 8, 2025Updated last year
- ☆15Jan 21, 2023Updated 3 years ago
- ☆17Mar 29, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆17May 20, 2026Updated last month
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆75Apr 25, 2025Updated last year
- ☆12Mar 26, 2024Updated 2 years ago
- [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT.☆22Jun 24, 2026Updated 3 weeks ago
- ☆14Dec 20, 2024Updated last year
- Fast SHA-256 that utilizes the GPU☆13Dec 17, 2021Updated 4 years ago
- Orchestrating many small GPU clusters for running serverless GPU workloads☆18Mar 15, 2026Updated 4 months ago
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆25Jan 6, 2026Updated 6 months ago
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆12Feb 3, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18May 28, 2024Updated 2 years ago
- Source code of the paper "OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs"☆16Aug 23, 2022Updated 3 years ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- ☆122Nov 17, 2023Updated 2 years ago
- An Open-Source Scaling Framework for Domain Specific Architectures☆63Updated this week
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- vLLM Router☆55Mar 11, 2024Updated 2 years ago
- [NeurIPS'25] The official code implementation for paper "R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Tok…☆94Apr 7, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆29Jun 29, 2026Updated 2 weeks ago
- ☆37Jan 27, 2018Updated 8 years ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆121Jun 19, 2024Updated 2 years ago
- llvmのAZ Processor Backend☆11Oct 29, 2013Updated 12 years ago
- [Mlsys'22] Understanding gnn computational graph: A coordinated computation, io, and memory perspective☆22Sep 11, 2023Updated 2 years ago
- 算子库☆17Jul 9, 2025Updated last year
- ngAP's artifact for ASPLOS'24☆25Jul 29, 2025Updated 11 months ago