Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
☆16Mar 21, 2025Updated last year
Alternatives and similar repositories for transformer_anatomy
Users that are interested in transformer_anatomy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17May 25, 2020Updated 6 years ago
- This is a repository for the paper on testing inductive bias with scaled-down RoBERTa models.☆21Jan 10, 2022Updated 4 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 5 years ago
- ☆17May 14, 2020Updated 6 years ago
- How to crawl the FRED big data in a rapid and methodical way☆10Oct 7, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆22Jun 18, 2021Updated 5 years ago
- ☆12Jul 31, 2020Updated 6 years ago
- ☆13Jul 4, 2020Updated 6 years ago
- What are the best Systems? New Perspectives on NLP Benchmarking☆13Mar 16, 2023Updated 3 years ago
- Deep Learning Seminar -- ÚFAL course NPFL117☆17Nov 22, 2022Updated 3 years ago
- Code for the paper "What Makes Better Augmentation Strategies? Augment Difficult but Not too Different" (ICLR 22)☆12Aug 28, 2023Updated 3 years ago
- ☆13Dec 8, 2022Updated 3 years ago
- Subword-level Word Vector Representations for Korean (ACL 2018)☆107Oct 17, 2019Updated 7 years ago
- ECIR'21: Simplified TinyBERT: Knowledge Distillation for Document Retrieval☆17Apr 25, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MultiCite code and data. Models are available on Huggingface.☆38May 10, 2022Updated 4 years ago
- Russian Artificial Text Detection☆20Nov 17, 2025Updated 11 months ago
- Implementation, trained models and result data for the paper "Aspect-based Document Similarity for Research Papers" #COLING2020☆64Apr 30, 2024Updated 2 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆21Feb 14, 2020Updated 6 years ago
- Codes for "Learning bounds for risk-sensitive learning," NeurIPS 2020 (or see arXiv 2006.08138)☆11Oct 15, 2020Updated 6 years ago
- ☆18Apr 26, 2021Updated 5 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆50Dec 6, 2024Updated last year
- ☆15Aug 2, 2022Updated 4 years ago
- ☆11May 26, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆46Oct 26, 2021Updated 5 years ago
- 한국어 악성댓글 데이터셋☆73Sep 26, 2020Updated 6 years ago
- Pre-trained Machine Translation Models of Korean from/to ECJ☆28Jul 15, 2019Updated 7 years ago
- 😼Help the cat escape☆10May 10, 2020Updated 6 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 3 years ago
- Code of papers WSDM'24 "Table Meets LLM" and EMNLP'24 "TAP4LLM"☆12Oct 25, 2026Updated last week
- Domain Adaptation and Adapters☆16Feb 28, 2023Updated 3 years ago
- 1:1 pegged coin with 1 potato☆11Jun 7, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for paper "TX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLP"☆10Dec 8, 2022Updated 3 years ago
- Self-supervised Label Augmentation via Input Transformations (ICML 2020)☆106Nov 28, 2020Updated 5 years ago
- Implementation of the GLOM model for text☆11Mar 4, 2021Updated 5 years ago
- Deep Learning experiments☆19Nov 18, 2019Updated 6 years ago
- Code for reproducing results in ICML 2020 paper "PackIt: A Virtual Environment for Geometric Planning"☆54Dec 12, 2024Updated last year
- Benchmark dataset for the evaluation of scientific article representations on the task of citation recommendation across various scientif…☆12Oct 21, 2022Updated 4 years ago
- Vim에서 LaTeX 사용하기위한 미니멀한 세팅☆10Jun 19, 2020Updated 6 years ago