Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.
☆22Apr 16, 2026Updated 6 months ago
Alternatives and similar repositories for LLM-para
Users that are interested in LLM-para are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆124Apr 26, 2025Updated last year
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- ☆125Nov 17, 2023Updated 2 years ago
- ☆11Apr 16, 2023Updated 3 years ago
- An Open-Source Scaling Framework for Domain Specific Architectures☆62Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple tutorial on SystemC using NJU's DLCO experiments as examples. (Rewritting...)☆16Aug 10, 2026Updated 2 months ago
- ☆42Sep 21, 2026Updated last month
- [ICCD26] A fast simulator for mixed-precision RRAM and SRAM compute-in-memory AI processors☆12Dec 11, 2025Updated 10 months ago
- [ICML 2026]A framework to compare low-bit integer and float-point formats☆84May 6, 2026Updated 5 months ago
- ☆21Jul 30, 2026Updated 3 months ago
- Artifact material for [HPCA 2025] #2108 "UniNDP: A Unified Compilation and Simulation Tool for Near DRAM Processing Architectures"☆63Sep 1, 2025Updated last year
- ☆17Mar 29, 2026Updated 7 months ago
- This repo contains the source code for our paper "LibRTS: A Spatial Indexing Library by Ray Tracing" published in PPoPP'25☆12Updated this week
- ☆13Nov 29, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A skill for automatically optimizing CUDA code.☆47Mar 26, 2026Updated 7 months ago
- PipeWeave: Synergizing Analytical and Learning Models for Unified GPU Performance Prediction☆23Sep 2, 2026Updated last month
- Instruction Pointer Classifier and Dynamic Degree Stream based Hardware Cache Prefetching☆16Nov 16, 2019Updated 6 years ago
- [ASPLOS'26] HILOS: A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs☆22Jan 18, 2026Updated 9 months ago
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆19Mar 30, 2025Updated last year
- A linker for partial GPU kernels.☆37Updated this week
- 训练营讲义☆21Jan 21, 2025Updated last year
- ☆14Dec 20, 2024Updated last year
- ☆15Jan 21, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Real-time Volumetric Fog Renderer☆14Jan 17, 2023Updated 3 years ago
- Processing-In-Memory (PIM) Simulator☆257Dec 12, 2024Updated last year
- An accelerator for high-dimensional approximate nearest neighbor search☆15May 17, 2025Updated last year
- CoralNPU behavior simulator based on MPACT-Sim☆28Oct 8, 2026Updated 3 weeks ago
- Light weight threading library for gem5 syscall emulator (git mirror)☆16Mar 1, 2017Updated 9 years ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving clu…☆111Updated this week
- ☆15May 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Educational implementation of Kimi Delta Attention from 'Kimi Linear: An Expressive, Efficient Attention Architecture' (arXiv:2510.26692)☆16Updated this week
- Source code of the paper "OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs"☆16Aug 23, 2022Updated 4 years ago
- ☆19May 28, 2024Updated 2 years ago
- ☆15Oct 7, 2021Updated 5 years ago
- Very small and high performance CPU☆13Dec 3, 2024Updated last year
- HBFSim (HBF Sim): an open-source High-Bandwidth Flash (HBF) simulator. Runs real LLM inference on a real GPU and injects modeled HBF timi…☆64Oct 23, 2026Updated last week
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆14Feb 3, 2025Updated last year