This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".
☆325Aug 2, 2021Updated 5 years ago
Alternatives and similar repositories for the-story-of-heads
Users that are interested in the-story-of-heads are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for the paper "Are Sixteen Heads Really Better than One?"☆175Apr 1, 2020Updated 6 years ago
- This is a repository with the code for the EMNLP 2020 paper "Information-Theoretic Probing with Minimum Description Length"☆76Aug 20, 2024Updated 2 years ago
- ☆475Apr 4, 2021Updated 5 years ago
- Code and Data release for "Improving Multilingual Translation by Representation and Gradient Regularization" (Yang et al. EMNLP 2021), an…☆13Aug 12, 2024Updated 2 years ago
- ☆21May 5, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.☆17Apr 25, 2021Updated 5 years ago
- ☆17Apr 28, 2022Updated 4 years ago
- ☆20Jan 16, 2024Updated 2 years ago
- Contrastive Attention Mechanism for Abstractive Text Summarization☆40Jan 14, 2020Updated 6 years ago
- Effective Attention Sheds Light On Interpretability - Findings of ACL2021☆11May 16, 2021Updated 5 years ago
- ☆87Apr 16, 2024Updated 2 years ago
- Measuring the Mixing of Contextual Information in the Transformer☆35May 27, 2023Updated 3 years ago
- Implementation of unregularized, l1 regularized and l2 regularized linear regression using numpy and without sklearn☆11Oct 4, 2019Updated 7 years ago
- ☆18Oct 6, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official Code for Towards Transparent and Explainable Attention Models paper (ACL 2020)☆36Jun 22, 2022Updated 4 years ago
- This repository contains the code for "How many data points is a prompt worth?"☆48Apr 7, 2021Updated 5 years ago
- ☆43Sep 16, 2020Updated 6 years ago
- ☆13Feb 7, 2023Updated 3 years ago
- Soft Contextual Data Augmentation☆39Jul 25, 2024Updated 2 years ago
- [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…☆141Dec 30, 2021Updated 4 years ago
- On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification☆29Nov 30, 2022Updated 3 years ago
- Transformer training code for sequential tasks☆610Sep 14, 2021Updated 5 years ago
- Understanding the Difficulty of Training Transformers☆331May 31, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- BertViz: Visualize Attention in Transformer Models☆8,210Jan 8, 2026Updated 9 months ago
- ☆16Jan 14, 2022Updated 4 years ago
- ☆27Jun 12, 2023Updated 3 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆109Oct 4, 2023Updated 3 years ago
- ☆38Apr 23, 2019Updated 7 years ago
- Code for the paper "Latent Relation Language Models" at AAAI-20.☆41Sep 22, 2025Updated last year
- A machine translation reading list maintained by Tsinghua Natural Language Processing Group☆2,432Aug 9, 2024Updated 2 years ago
- This repository contains datasets (including testing set) for EMNLP-IJCNLP 2019 paper "BiPaR: A Bilingual Parallel Dataset for Multilingu…☆23Jul 13, 2021Updated 5 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆123Sep 22, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Measuring if attention is explanation with ROAR☆22Mar 3, 2023Updated 3 years ago
- Source code for "Importance-based Neuron Allocation for Multilingual Neural Machine Translation"☆12Sep 15, 2021Updated 5 years ago
- Variable-order CRFs with structure learning☆17Oct 16, 2026Updated 2 weeks ago
- A tool for holistic analysis of language generations systems☆471Sep 22, 2025Updated last year
- Improving the Transformer translation model with document-level context☆169Jul 7, 2020Updated 6 years ago
- Data and code used in our NAACL'19 paper "Selective Attention for Context-aware Neural Machine Translation"☆30Apr 12, 2020Updated 6 years ago
- ☆329Jun 21, 2022Updated 4 years ago