A collection of resources to study Transformers in depth.
☆565Nov 25, 2023Updated 2 years ago
Alternatives and similar repositories for transformer
Users that are interested in transformer are comparing it to the libraries listed below
Sorting:
- Must-read Papers on pre-trained language models.☆3,362Nov 6, 2022Updated 3 years ago
- curated collection of papers for the nlp practitioner 📖👩🔬☆1,072Aug 5, 2020Updated 5 years ago
- NLP library designed for reproducible experimentation management☆294Jul 25, 2024Updated last year
- Papers & presentation materials from Hugging Face's internal science day☆2,052Oct 31, 2020Updated 5 years ago
- XLNet for generating language.☆166Jan 30, 2021Updated 5 years ago
- ✍️ A carefully curated list of NLP paper summaries☆1,478Dec 4, 2021Updated 4 years ago
- Repository of code for the tutorial on Transfer Learning in NLP held at NAACL 2019 in Minneapolis, MN, USA☆722Oct 16, 2019Updated 6 years ago
- Super easy library for BERT based NLP models☆1,919Aug 19, 2024Updated last year
- ☆263Dec 10, 2019Updated 6 years ago
- Tutorial for International Summer School on Deep Learning, 2019☆317Apr 4, 2022Updated 3 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,926Feb 14, 2023Updated 3 years ago
- Natural Language Processing Best Practices & Examples☆6,448Aug 30, 2022Updated 3 years ago
- 🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy☆1,402Nov 7, 2025Updated 4 months ago
- A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)☆5,620Jan 12, 2026Updated last month
- BERT-related papers☆2,040Aug 12, 2023Updated 2 years ago
- Transformer training code for sequential tasks☆609Sep 14, 2021Updated 4 years ago
- Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the mo…☆22,981Jul 28, 2024Updated last year
- Supporting example for "A Rust SentencePiece implementation"☆20Jun 7, 2020Updated 5 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,180Nov 27, 2021Updated 4 years ago
- Neural Text Generation with Unlikelihood Training☆310Aug 31, 2021Updated 4 years ago
- 📰Natural language processing (NLP) newsletter☆303Jul 20, 2020Updated 5 years ago
- Misspelling Oblivious Word Embeddings☆201Aug 6, 2019Updated 6 years ago
- LM Pretraining with PyTorch/TPU☆137Oct 24, 2019Updated 6 years ago
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)☆200Jul 6, 2023Updated 2 years ago
- 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP☆1,195Aug 1, 2023Updated 2 years ago
- Unsupervised text tokenizer focused on computational efficiency☆975Mar 29, 2024Updated last year
- 🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code☆2,827Jun 23, 2023Updated 2 years ago
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020☆606Jun 4, 2020Updated 5 years ago
- jiant is an nlp toolkit☆1,674Jul 6, 2023Updated 2 years ago
- Fast Block Sparse Matrices for Pytorch☆549Jan 21, 2021Updated 5 years ago
- The Natural Language Decathlon: A Multitask Challenge for NLP☆2,340May 1, 2025Updated 10 months ago
- An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)☆451Feb 22, 2026Updated last week
- A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dm…☆10,053Apr 15, 2023Updated 2 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆159Nov 21, 2019Updated 6 years ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"☆200Dec 2, 2020Updated 5 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,176May 28, 2023Updated 2 years ago
- An open-source NLP research library, built on PyTorch.☆11,889Nov 22, 2022Updated 3 years ago
- A natural language modeling framework based on PyTorch☆6,305Oct 17, 2022Updated 3 years ago
- ☆104Jan 14, 2021Updated 5 years ago