mertensu / transformer-tutorial
Visualising the Transformer encoder
☆111Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for transformer-tutorial
- http://nlp.seas.harvard.edu/2018/04/03/attention.html☆63Updated 3 years ago
- ☆101Updated 3 years ago
- 📄 A repo containing notes and discussions for our weekly NLP/ML paper discussions.☆149Updated 4 years ago
- A tiny Catalyst-like experiment runner framework on top of micrograd.☆52Updated 3 years ago
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆70Updated 4 years ago
- Docs☆143Updated last month
- Create interactive textual heat maps for Jupiter notebooks☆196Updated 5 months ago
- Distillation of BERT model with catalyst framework☆75Updated last year
- LM Pretraining with PyTorch/TPU☆132Updated 5 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Updated 3 years ago
- 📰Natural language processing (NLP) newsletter☆301Updated 4 years ago
- Use fastai-v2 with HuggingFace's pretrained transformers☆111Updated 4 years ago
- Python implementation of GLN in different frameworks☆95Updated 4 years ago
- ☆108Updated last year
- ☆155Updated 4 years ago
- A demonstration of the attention mechanism with some toy experiments and explanations.☆106Updated 6 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 3 years ago
- diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.☆81Updated last year
- Experiment orchestration☆103Updated 4 years ago
- Creates a learning-curve plot for Jupyter/Colab notebooks that is updated in real-time.☆175Updated 2 years ago
- The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761☆284Updated 4 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆363Updated 2 years ago
- a lightweight transformer library for PyTorch☆72Updated 3 years ago
- Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.☆54Updated 4 years ago
- ☆45Updated 5 years ago
- Manifold-Mixup implementation for fastai V1☆19Updated 4 years ago
- Check if you have training samples in your test set☆64Updated 2 years ago
- ☆264Updated 4 years ago
- TF2.0 port for Augmix paper☆79Updated 4 years ago
- Cornell Birdcall Identification (a Kaggle competition) starter pack☆53Updated last year