Alternatives and similar repositories for pruning-sparsity-publications:

Users that are interested in pruning-sparsity-publications are comparing it to the libraries listed below

• IntelLabs / Hardware-Aware-Automated-Machine-Learning
  ☆46Updated this week
• mit-han-lab / tinychat-tutorial
  ☆61Updated 4 months ago
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆20Updated 4 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆53Updated 2 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆64Updated last month
• mit-han-lab / parallel-computing-tutorial
  ☆159Updated last year
• zhangsichengsjtu / AFPQ
  AFPQ code implementation
  ☆20Updated last year
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆50Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆99Updated 2 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆141Updated 2 years ago
• microsoft / chunk-attention
  ☆64Updated 3 months ago
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated last year
• Qualcomm-AI-research / gptvq
  ☆27Updated 11 months ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆58Updated last year
• HuangOwen / QAT-ACS
  [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"
  ☆30Updated 7 months ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆89Updated 3 weeks ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆106Updated 6 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆48Updated 2 years ago
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆107Updated 10 months ago
• htqin / BiBench
  [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…
  ☆55Updated last year
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆71Updated 3 months ago
• CalebDu / Awesome-Cute
  ☆46Updated 2 months ago
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆21Updated last year
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆45Updated 4 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆119Updated 6 months ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆29Updated last year