A collection of resources to study Transformers in depth.
β565Nov 25, 2023Updated 2 years ago
Alternatives and similar repositories for transformer
Users that are interested in transformer are comparing it to the libraries listed below
Sorting:
- Must-read Papers on pre-trained language models.β3,362Nov 6, 2022Updated 3 years ago
- curated collection of papers for the nlp practitioner ππ©βπ¬β1,072Aug 5, 2020Updated 5 years ago
- NLP library designed for reproducible experimentation managementβ294Jul 25, 2024Updated last year
- Papers & presentation materials from Hugging Face's internal science dayβ2,052Oct 31, 2020Updated 5 years ago
- XLNet for generating language.β166Jan 30, 2021Updated 5 years ago
- βοΈ A carefully curated list of NLP paper summariesβ1,478Dec 4, 2021Updated 4 years ago
- Repository of code for the tutorial on Transfer Learning in NLP held at NAACL 2019 in Minneapolis, MN, USAβ722Oct 16, 2019Updated 6 years ago
- Super easy library for BERT based NLP modelsβ1,919Aug 19, 2024Updated last year
- β263Dec 10, 2019Updated 6 years ago
- Tutorial for International Summer School on Deep Learning, 2019β317Apr 4, 2022Updated 3 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.β2,926Feb 14, 2023Updated 3 years ago
- Natural Language Processing Best Practices & Examplesβ6,448Aug 30, 2022Updated 3 years ago
- πΈ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCyβ1,402Nov 7, 2025Updated 4 months ago
- A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)β5,620Jan 12, 2026Updated last month
- BERT-related papersβ2,040Aug 12, 2023Updated 2 years ago
- Transformer training code for sequential tasksβ609Sep 14, 2021Updated 4 years ago
- Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the moβ¦β22,981Jul 28, 2024Updated last year
- Supporting example for "A Rust SentencePiece implementation"β20Jun 7, 2020Updated 5 years ago
- Single Headed Attention RNN - "Stop thinking with your head"β1,180Nov 27, 2021Updated 4 years ago
- Neural Text Generation with Unlikelihood Trainingβ310Aug 31, 2021Updated 4 years ago
- π°Natural language processing (NLP) newsletterβ303Jul 20, 2020Updated 5 years ago
- Misspelling Oblivious Word Embeddingsβ201Aug 6, 2019Updated 6 years ago
- LM Pretraining with PyTorch/TPUβ137Oct 24, 2019Updated 6 years ago
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)β200Jul 6, 2023Updated 2 years ago
- πHMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLPβ1,195Aug 1, 2023Updated 2 years ago
- Unsupervised text tokenizer focused on computational efficiencyβ975Mar 29, 2024Updated last year
- πͺβKnock Knock: Get notified when your training ends with only two additional lines of codeβ2,827Jun 23, 2023Updated 2 years ago
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020β606Jun 4, 2020Updated 5 years ago
- jiant is an nlp toolkitβ1,674Jul 6, 2023Updated 2 years ago
- Fast Block Sparse Matrices for Pytorchβ549Jan 21, 2021Updated 5 years ago
- The Natural Language Decathlon: A Multitask Challenge for NLPβ2,340May 1, 2025Updated 10 months ago
- An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)β451Feb 22, 2026Updated last week
- A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dmβ¦β10,053Apr 15, 2023Updated 2 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERTβ159Nov 21, 2019Updated 6 years ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"β200Dec 2, 2020Updated 5 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understandingβ6,176May 28, 2023Updated 2 years ago
- An open-source NLP research library, built on PyTorch.β11,889Nov 22, 2022Updated 3 years ago
- A natural language modeling framework based on PyTorchβ6,305Oct 17, 2022Updated 3 years ago
- β104Jan 14, 2021Updated 5 years ago