Layer-wise Pruning of Transformer Heads for Efficient Language Modeling
☆22Feb 22, 2022Updated 4 years ago
Alternatives and similar repositories for Attention-Head-Pruning
Users that are interested in Attention-Head-Pruning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Hardware-accelerated matrix/numeric programming library for Swift☆13Sep 2, 2025Updated last year
- This repo uses a combination of logits and feature distillation method to teach the PSPNet model of ResNet18 backbone with the PSPNet mod…☆11Sep 30, 2021Updated 5 years ago
- PyTorch implementation of "Nextformer: A ConvNeXt Augmented Conformer For End-To-End Speech Recognition"☆10Dec 15, 2022Updated 3 years ago
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- ☆10Aug 18, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An unofficial non-causal Tensorflow implementation of "Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Spee…☆13Dec 27, 2022Updated 3 years ago
- This model's weights are converted from Flownet of Nvidia☆12Jun 25, 2019Updated 7 years ago
- Naive spectrogram built with accelerate☆14Sep 15, 2018Updated 8 years ago
- A multi-producer multi-consumer lock-free ring buffer implementation☆15Jul 21, 2019Updated 7 years ago
- ☆12Feb 23, 2023Updated 3 years ago
- final-project-level3-nlp-02 created by GitHub Classroom☆11Dec 31, 2021Updated 4 years ago
- MXF I/O library written in C☆15Nov 22, 2023Updated 2 years ago
- A swift implementation of Schema.org structured data vocabulary.☆12Feb 23, 2025Updated last year
- ☆48Aug 7, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An original package of the dynamic compressive gammachirp filterbank (dcGC-FB)☆14Sep 27, 2026Updated 3 weeks ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Code for High-Capacity Expert Binary Networks (ICLR 2021).☆27Dec 3, 2021Updated 4 years ago
- Swift library for generating and working with UUIDs☆17Feb 7, 2022Updated 4 years ago
- Learnable Gammatone Filterbank (LGTFB) and Equal-loudness Normalization (EN)☆13Apr 24, 2020Updated 6 years ago
- Efficient LLM Inference Acceleration using Prompting☆50Oct 22, 2024Updated last year
- Parse and create CommonMark documents in Swift.☆23Jan 23, 2023Updated 3 years ago
- ☆22Sep 2, 2020Updated 6 years ago
- Code for Analyzing Redundancy in Pretrained Transformer Models accepted at EMNLP 2020☆14Oct 6, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Proof system for Fact Verification☆14Jun 7, 2022Updated 4 years ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Dec 30, 2021Updated 4 years ago
- CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization☆12Aug 3, 2024Updated 2 years ago
- Codes for "NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer" (ACL 2021 findings)☆15Nov 3, 2021Updated 4 years ago
- ☆19Oct 3, 2024Updated 2 years ago
- This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs☆44Aug 14, 2024Updated 2 years ago
- TextField replacement for SwiftUI that restricts input to numbers☆20Jun 8, 2021Updated 5 years ago
- Code for RECENT☆13Dec 18, 2022Updated 3 years ago
- Repo for our Paper: Cross Quality LFW: A database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environments☆19Nov 25, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🔥 당신을 추천하는 가장 좋은 방법 RecommendU @boostcampaitech4☆18Feb 27, 2023Updated 3 years ago
- Swift package containing useful code for AUv3 components.☆25Dec 31, 2025Updated 9 months ago
- '내마리'는 나의 이야기에 귀를 기울임으로써 나에게 공감하고, 이야기의 맥락을 파악하고, 더 깊은 내용을 질문해주는 챗봇입니다.☆13Sep 9, 2023Updated 3 years ago
- compare the theory attention gradient with PyTorch attention gradient☆16Apr 1, 2024Updated 2 years ago
- different AI algorithms to solve board games☆18Nov 4, 2018Updated 7 years ago
- Code for ACL 2022 paper "Semi-Supervised Formality Style Transfer with Consistency Training".☆17May 21, 2022Updated 4 years ago
- Training wheels, side rails, and helicopter parent for your Deep Learning projects in PyTorch☆24Sep 23, 2023Updated 3 years ago