FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration
☆20Jun 27, 2025Updated 8 months ago
Alternatives and similar repositories for fireq
Users that are interested in fireq are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation of "Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming" (ICML'23)☆13Jul 11, 2024Updated last year
- Autocomp: AI-Driven Code Optimizer for Tensor Accelerators☆74Feb 24, 2026Updated last week
- [ICML 2024] Sparse Model Inversion: Efficient Inversion of Vision Transformers with Less Hallucination☆13Apr 29, 2025Updated 10 months ago
- ☆27Jan 3, 2025Updated last year
- ☆10Apr 24, 2024Updated last year
- ☆52Nov 5, 2024Updated last year
- [CVPR 2025 Highlight] FIMA-Q: Post-Training Quantization for Vision Transformers by Fisher Information Matrix Approximation☆26Jun 16, 2025Updated 8 months ago
- Source code of our TNNLS paper "Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution"☆12Apr 14, 2023Updated 2 years ago
- [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆39Feb 4, 2025Updated last year
- ☆15Jan 12, 2026Updated last month
- ☆13Jul 14, 2025Updated 7 months ago
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆22Jul 4, 2025Updated 8 months ago
- [ICML 2025] Official PyTorch implementation of "NegMerge: Sign-Consensual Weight Merging for Machine Unlearning"☆14Nov 25, 2025Updated 3 months ago
- 交通部808协议 wireshark解析 jt808 protocol wireshark☆10Feb 20, 2021Updated 5 years ago
- The official code for "Advancing Multimodal Large Language Models with Quantization-Aware Scale Learning for Efficient Adaptation" | [MM2…☆14Dec 7, 2024Updated last year
- The first large scale formally verified reasoning dataset for Verilog☆20May 16, 2025Updated 9 months ago
- ☆27Nov 5, 2024Updated last year
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆21May 23, 2025Updated 9 months ago
- ☆11Apr 5, 2023Updated 2 years ago
- Official Implementation of Robustifying and Boosting Training-Free Neural Architecture Search☆10Mar 12, 2024Updated last year
- [CVPR 2025] QuartDepth☆17Mar 24, 2025Updated 11 months ago
- ☆17Mar 10, 2025Updated 11 months ago
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆14Jun 26, 2025Updated 8 months ago
- ☆20Dec 16, 2025Updated 2 months ago
- ☆13Jul 25, 2024Updated last year
- A research project exploring fine-tuning BERT-style models for text generation☆36Nov 30, 2025Updated 3 months ago
- ☆11Sep 20, 2024Updated last year
- [ICCAD 2025] Squant☆15Jul 3, 2025Updated 8 months ago
- ☆20Jan 30, 2026Updated last month
- Code for Optimized Arrhythmia Detection on Ultra-Edge Devices☆11May 26, 2022Updated 3 years ago
- Official PyTorch implementation of the paper entitled 'Self Attentive Pooling for Efficient Deep Learning'.☆13May 3, 2024Updated last year
- First Latency-Aware Competitive LLM Agent Benchmark☆26Jun 3, 2025Updated 9 months ago
- ☆12Jul 30, 2025Updated 7 months ago
- KV cache compression via sparse coding☆17Oct 26, 2025Updated 4 months ago
- A Wireshark dissector for the Niagara FOX protocol written in LUA☆15Jul 2, 2021Updated 4 years ago
- ☆15Apr 11, 2024Updated last year
- ☆14Aug 19, 2024Updated last year
- MICRO 2024 Evaluation Artifact for FuseMax☆16Aug 26, 2024Updated last year
- ☆27Feb 27, 2025Updated last year