mit-han-lab / pruning-sparsity-publications
☆22Updated last year
Alternatives and similar repositories for pruning-sparsity-publications:
Users that are interested in pruning-sparsity-publications are comparing it to the libraries listed below
- ☆59Updated 3 months ago
- ☆156Updated last year
- ☆134Updated last year
- The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…☆48Updated 2 years ago
- ☆10Updated last year
- LLM Inference with Microscaling Format☆17Updated 3 months ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆48Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 11 months ago
- ☆60Updated 3 weeks ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…☆57Updated 11 months ago
- 📚FFPA: Yet antother Faster Flash Prefill Attention with O(1)⚡️SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster than SDPA EA.☆96Updated this week
- TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.☆53Updated this week
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆47Updated last year
- ☆197Updated 3 years ago
- llama INT4 cuda inference with AWQ☆50Updated 3 weeks ago
- Implement Flash Attention using Cute.☆69Updated last month
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…☆54Updated 11 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆64Updated 7 months ago
- Code Repository of Evaluating Quantized Large Language Models☆116Updated 5 months ago
- A collection of research papers on efficient training of DNNs☆69Updated 2 years ago
- ☆31Updated 3 months ago
- [CVPRW 2021] Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms☆29Updated 2 years ago
- A TVM-like CUDA/C code generator.☆9Updated 3 years ago
- [NeurIPS 2024] Search for Efficient LLMs☆12Updated 3 weeks ago
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆157Updated 7 months ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆32Updated last year
- ☆25Updated last year
- 📚 A curated list of awesome matrix-matrix multiplication (A * B = C) frameworks, libraries and software☆21Updated 2 weeks ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆103Updated 5 months ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆19Updated 2 years ago