mit-han-lab / pruning-sparsity-publications

Related projects: ⓘ

• mit-han-lab / tinychat-tutorial
  ☆37Updated 2 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆134Updated last year
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆69Updated 4 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆82Updated 6 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆93Updated last week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆46Updated 2 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆113Updated last year
• htqin / BiBench
  [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…
  ☆54Updated 6 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆35Updated 4 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆58Updated 6 months ago
• AlibabaPAI / FLASHNN
  ☆67Updated last week
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆114Updated last week
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆50Updated 3 months ago
• microsoft / chunk-attention
  ☆29Updated 4 months ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆27Updated 6 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆46Updated last year
• Qualcomm-AI-research / transformer-quantization
  ☆186Updated 2 years ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆159Updated 3 months ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆30Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆81Updated 2 months ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆21Updated 9 months ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆19Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated 9 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆166Updated 11 months ago
• NVlabs / EfficientDL
  ☆30Updated 3 months ago
• tridao / cutlass_quant
  ☆16Updated this week
• zhangsichengsjtu / AFPQ
  AFPQ code implementation
  ☆15Updated 10 months ago
• ColfaxResearch / cutlass-kernels
  ☆138Updated 2 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆73Updated 3 months ago