Layer-wise Pruning of Transformer Heads for Efficient Language Modeling
☆22Feb 22, 2022Updated 4 years ago
Alternatives and similar repositories for Attention-Head-Pruning
Users that are interested in Attention-Head-Pruning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference☆14Feb 22, 2022Updated 4 years ago
- ipython notebooks for feature extraction and training of audio event classifier on ESC-50 dataset.☆10Mar 16, 2018Updated 8 years ago
- Contains the k2arm framework, results and slides from the presentation at Forum Künstliche Intelligenz☆14May 15, 2019Updated 7 years ago
- [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems☆17Nov 1, 2025Updated 8 months ago
- This repo investigates LLMs' tendency to exhibit acquiescence bias in sequential QA interactions. Includes evaluation methods, datasets, …☆17Apr 24, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repo uses a combination of logits and feature distillation method to teach the PSPNet model of ResNet18 backbone with the PSPNet mod…☆11Sep 30, 2021Updated 4 years ago
- ☆10Aug 18, 2022Updated 3 years ago
- ☆13Sep 24, 2023Updated 2 years ago
- An unofficial non-causal Tensorflow implementation of "Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Spee…☆14Dec 27, 2022Updated 3 years ago
- Naive spectrogram built with accelerate☆14Sep 15, 2018Updated 7 years ago
- Test Suite for common defects in Audio Unit plug-ins☆15Sep 4, 2014Updated 11 years ago
- MXF I/O library written in C☆15Nov 22, 2023Updated 2 years ago
- PET-SQL: A Prompt-enhanced Two-stage Text-to-SQL Framework with Cross-consistency☆20Mar 29, 2024Updated 2 years ago
- ☆48Aug 7, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 😎 Awesome papers on token redundancy reduction☆14Mar 12, 2025Updated last year
- Code for High-Capacity Expert Binary Networks (ICLR 2021).☆27Dec 3, 2021Updated 4 years ago
- Proof system for Fact Verification☆14Jun 7, 2022Updated 4 years ago
- FFT methods: Rader and Bluestein. Implemented in Python.☆17Dec 30, 2021Updated 4 years ago
- Parse and create CommonMark documents in Swift.☆23Jan 23, 2023Updated 3 years ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Dec 30, 2021Updated 4 years ago
- ☆10Nov 22, 2022Updated 3 years ago
- 使用yolov5和ncnn，将其部署到安卓移动端，我提供了精心挑选的相互匹配的版本，不会报错，为您节省了许多时间☆13Jul 22, 2022Updated 4 years ago
- Open source codebase for PRBench☆18Jan 15, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TextField replacement for SwiftUI that restricts input to numbers☆20Jun 8, 2021Updated 5 years ago
- Code for RECENT☆13Dec 18, 2022Updated 3 years ago
- Repo for our Paper: Cross Quality LFW: A database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environments☆19Nov 25, 2022Updated 3 years ago
- 🔥 당신을 추천하는 가장 좋은 방법 RecommendU @boostcampaitech4☆18Feb 27, 2023Updated 3 years ago
- '내마리'는 나의 이야기에 귀를 기울임으로써 나에게 공감하고, 이야기의 맥락을 파악하고, 더 깊은 내용을 질문해주는 챗봇입니다.☆13Sep 9, 2023Updated 2 years ago
- Deploy mlflow models as JSON APIs with minimal new code☆20Apr 10, 2026Updated 3 months ago
- Training wheels, side rails, and helicopter parent for your Deep Learning projects in PyTorch☆24Sep 23, 2023Updated 2 years ago
- Vision Transformer Pruning☆57Dec 9, 2021Updated 4 years ago
- Experiments codes for WSDM '24 paper "MultiFS: Automated Multi-Scenario Feature Selection in Deep Recommender Systems"☆11May 31, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [NeurIPS2022] Where to Pay Attention in Sparse Training for Feature Selection?☆12Feb 10, 2023Updated 3 years ago
- ☆24Jul 25, 2024Updated 2 years ago
- Code for Our EMNLP (Industry) 2023 paper "LLM4Vis: Explainable Visualization Recommendation using ChatGPT"☆29Feb 4, 2024Updated 2 years ago
- ☆19Oct 24, 2023Updated 2 years ago
- ☆30Jul 28, 2024Updated 2 years ago
- 测试 https://huggingface.co/OFA-Sys/gsm8k-rft-llama7b-u13b 的 GSM8K 分数☆15Aug 10, 2023Updated 2 years ago
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Mar 16, 2023Updated 3 years ago