Alternatives and similar repositories for pruning-sparsity-publications:

Users that are interested in pruning-sparsity-publications are comparing it to the libraries listed below

• mit-han-lab / tinychat-tutorial
  ☆59Updated 2 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆151Updated last year
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆26Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆52Updated last month
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆45Updated last year
• Qualcomm-AI-research / lr-qat
  ☆28Updated 2 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆58Updated last week
• GATECH-EIC / Edge-LLM
  [DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive La…
  ☆40Updated 7 months ago
• yifanlu0227 / LLaMA2-7B-on-laptop
  Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
  ☆13Updated last year
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆61Updated 3 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆132Updated last year
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
  ☆27Updated 2 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆67Updated last month
• microsoft / chunk-attention
  ☆59Updated last month
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆114Updated 4 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆48Updated last year
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆160Updated last month
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆17Updated 2 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆50Updated last week
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆56Updated 10 months ago
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆98Updated 8 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆195Updated last year
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆19Updated 2 years ago
• mobiusml / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆21Updated 10 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆34Updated 2 months ago
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆175Updated this week
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆88Updated 11 months ago