ChengZhang-98 / llm-mixed-qLinks
Official implementation of EMNLP'23 paper "Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?"
☆23Updated last year
Alternatives and similar repositories for llm-mixed-q
Users that are interested in llm-mixed-q are comparing it to the libraries listed below
Sorting:
- ☆29Updated this week
- ☆107Updated last year
- ☆49Updated last month
- Simulator for BitFusion☆101Updated 5 years ago
- Implementation of Microscaling data formats in SystemVerilog.☆23Updated last month
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆20Updated last year
- A co-design architecture on sparse attention☆51Updated 4 years ago
- ☆178Updated last year
- MICRO22 artifact evaluation for Sparseloop☆44Updated 3 years ago
- ☆48Updated 4 years ago
- [HPCA 2023] ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design☆115Updated 2 years ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆29Updated last year
- [TCAD'23] AccelTran: A Sparsity-Aware Accelerator for Transformers☆51Updated last year
- [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning☆101Updated last year
- ☆41Updated last year
- ☆35Updated 5 years ago
- ☆16Updated 2 years ago
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆51Updated 4 months ago
- Accelergy is an energy estimation infrastructure for accelerator energy estimations☆147Updated 3 months ago
- RTL implementation of Flex-DPE.☆110Updated 5 years ago
- BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)☆41Updated 4 years ago
- [TRETS 2025][FPGA 2024] FPGA Accelerator for Imbalanced SpMV using HLS☆14Updated this week
- ☆65Updated last week
- A bit-level sparsity-awared multiply-accumulate process element.☆16Updated last year
- [ASPLOS 2024] CIM-MLC: A Multi-level Compilation Stack for Computing-In-Memory Accelerators☆43Updated last year
- A framework for fast exploration of the depth-first scheduling space for DNN accelerators☆40Updated 2 years ago
- Torch2Chip (MLSys, 2024)☆53Updated 4 months ago
- Fast Emulation of Approximate DNN Accelerators in PyTorch☆25Updated last year
- ☆33Updated 4 years ago
- A Reconfigurable Accelerator with Data Reordering Support for Low-Cost On-Chip Dataflow Switching☆58Updated last week