ChengZhang-98 / llm-mixed-q
Official implementation of EMNLP'23 paper "Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?"
☆19Updated last year
Alternatives and similar repositories for llm-mixed-q:
Users that are interested in llm-mixed-q are comparing it to the libraries listed below
- ☆31Updated 4 months ago
- ☆26Updated last week
- ☆97Updated last year
- Implementation of Microscaling data formats in SystemVerilog.☆17Updated 8 months ago
- A co-design architecture on sparse attention☆52Updated 3 years ago
- Simulator for BitFusion☆99Updated 4 years ago
- MICRO22 artifact evaluation for Sparseloop☆43Updated 2 years ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆26Updated last year
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆14Updated 10 months ago
- Multi-core HW accelerator mapping optimization framework for layer-fused ML workloads.☆51Updated last week
- ☆14Updated 2 years ago
- ☆34Updated 4 years ago
- ☆26Updated last month
- ☆45Updated 3 years ago
- A framework for fast exploration of the depth-first scheduling space for DNN accelerators☆38Updated 2 years ago
- [TCAD'23] AccelTran: A Sparsity-Aware Accelerator for Transformers☆40Updated last year
- The codes and artifacts associated with our MICRO'22 paper titled: "Adaptable Butterfly Accelerator for Attention-based NNs via Hardware …☆129Updated last year
- Fast Emulation of Approximate DNN Accelerators in PyTorch☆22Updated last year
- Model LLM inference on single-core dataflow accelerators☆10Updated 2 months ago
- ☆39Updated 10 months ago
- ☆18Updated 2 years ago
- Torch2Chip (MLSys, 2024)☆51Updated last month
- RTL implementation of Flex-DPE.☆99Updated 5 years ago
- Linux docker for the DNN accelerator exploration infrastructure composed of Accelergy and Timeloop☆52Updated 2 weeks ago
- A bit-level sparsity-awared multiply-accumulate process element.☆15Updated 9 months ago
- Sparse CNN Accelerator targeting Intel FPGA☆11Updated 3 years ago
- BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)☆40Updated 4 years ago
- An open-source parameterizable NPU generator with full-stack multi-target compilation stack for intelligent workloads.☆51Updated last month
- [FPGA 2024]FPGA Accelerator for Imbalanced SpMV using HLS☆12Updated 2 months ago
- Serpens is an HBM FPGA accelerator for SpMV☆18Updated 9 months ago