Alternatives and similar repositories for nn_pruning:

Users that are interested in nn_pruning are comparing it to the libraries listed below

• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆718Updated 2 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆195Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆259Updated 2 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆704Updated last year
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• IntelLabs / Model-Compression-Research-Package
  A library for researching neural networks compression and acceleration methods.
  ☆141Updated 6 months ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆786Updated last year
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆312Updated last year
• kssteven418 / I-BERT
  [ICML'21 Oral] I-BERT: Integer-only BERT Quantization
  ☆239Updated 2 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆331Updated 8 months ago
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆180Updated 2 years ago
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆611Updated 2 years ago
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆275Updated last week
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆516Updated last year
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆747Updated last year
• Qualcomm-AI-research / transformer-quantization
  ☆202Updated 3 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆782Updated this week
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆430Updated 2 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• microsoft / varuna
  ☆246Updated 7 months ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆473Updated 2 years ago
• castorini / DeeBERT
  DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
  ☆155Updated 2 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆504Updated 3 years ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆574Updated last year
• lena-voita / the-story-of-heads
  This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…
  ☆310Updated 3 years ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆680Updated 7 months ago
• bzhangGo / rmsnorm
  Root Mean Square Layer Normalization
  ☆230Updated last year
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆171Updated 4 years ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆358Updated 2 weeks ago