mit-han-lab / spatten
[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
☆81Updated 4 months ago
Alternatives and similar repositories for spatten:
Users that are interested in spatten are comparing it to the libraries listed below
- ☆85Updated last year
- [TCAD'23] AccelTran: A Sparsity-Aware Accelerator for Transformers☆33Updated last year
- ☆42Updated 3 years ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆24Updated 10 months ago
- [HPCA 2023] ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design☆102Updated last year
- ☆21Updated this week
- A co-design architecture on sparse attention☆48Updated 3 years ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆13Updated 6 months ago
- ViTALiTy (HPCA'23) Code Repository☆20Updated last year
- ☆31Updated 4 years ago
- The codes and artifacts associated with our MICRO'22 paper titled: "Adaptable Butterfly Accelerator for Attention-based NNs via Hardware …☆118Updated last year
- MICRO22 artifact evaluation for Sparseloop☆41Updated 2 years ago
- SSR: Spatial Sequential Hybrid Architecture for Latency Throughput Tradeoff in Transformer Acceleration (Full Paper Accepted in FPGA'24)☆27Updated 5 months ago
- ☆25Updated last month
- ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference☆83Updated last month
- Open-source Framework for HPCA2024 paper: Gemini: Mapping and Architecture Co-exploration for Large-scale DNN Chiplet Accelerators☆65Updated 4 months ago
- Linux docker for the DNN accelerator exploration infrastructure composed of Accelergy and Timeloop☆47Updated this week
- An FPGA accelerator for general-purpose Sparse-Matrix Dense-Matrix Multiplication (SpMM).☆75Updated 5 months ago
- An open-source parameterizable NPU generator with full-stack multi-target compilation stack for intelligent workloads.☆38Updated last week
- A framework for fast exploration of the depth-first scheduling space for DNN accelerators☆35Updated last year
- Multi-core HW accelerator mapping optimization framework for layer-fused ML workloads.☆46Updated this week
- The framework for the paper "Inter-layer Scheduling Space Definition and Exploration for Tiled Accelerators" in ISCA 2023.☆58Updated this week
- Open-source of MSD framework☆16Updated last year
- ☆16Updated last month
- RTL implementation of Flex-DPE.☆97Updated 4 years ago
- A Reconfigurable Accelerator with Data Reordering Support for Low-Cost On-Chip Dataflow Switching☆43Updated 3 months ago
- Edge-MoE: Memory-Efficient Multi-Task Vision Transformer Architecture with Task-level Sparsity via Mixture-of-Experts☆98Updated 8 months ago
- Implementation of Microscaling data formats in SystemVerilog.☆13Updated 4 months ago
- ☆50Updated 4 months ago
- ☆38Updated last year