seanswyi / transformer-implementationLinks
Personal implementation of the Transformer paper.
โ22Updated last year
Alternatives and similar repositories for transformer-implementation
Users that are interested in transformer-implementation are comparing it to the libraries listed below
Sorting:
- NLP Examples using the ๐ค librariesโ40Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.โ147Updated 4 years ago
- A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+โ37Updated 4 years ago
- A ๐ค-style implementation of BERT using lambda layers instead of self-attentionโ69Updated 4 years ago
- โ46Updated 5 years ago
- On Generating Extended Summaries of Long Documentsโ78Updated 4 years ago
- Visualising the Transformer encoderโ111Updated 4 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER modelsโ33Updated 3 years ago
- A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs.โฆโ75Updated 4 years ago
- Implementation, trained models and result data for the paper "Aspect-based Document Similarity for Research Papers" #COLING2020โ63Updated last year
- Fine-tune transformers with pytorch-lightningโ44Updated 3 years ago
- Distillation of BERT model with catalyst frameworkโ78Updated 2 years ago
- http://nlp.seas.harvard.edu/2018/04/03/attention.htmlโ62Updated 4 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.โ127Updated 4 years ago
- A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorchโ228Updated 2 years ago
- This is the second part of the Deep Learning Course for the Master in High-Performance Computing (SISSA/ICTP).)โ33Updated 4 years ago
- A deep learning library based on Pytorch focussed on low resource language research and robustnessโ70Updated 3 years ago
- The "tl;dr" on a few notable transformer papers (pre-2022).โ190Updated 2 years ago
- Tutorial to pretrain & fine-tune a ๐ค Flax T5 model on a TPUv3-8 with GCPโ58Updated 3 years ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.โ105Updated 3 years ago
- โ103Updated 4 years ago
- Multitask Learning with Pretrained Transformersโ40Updated 4 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Selfโฆโ204Updated 3 years ago
- โ30Updated 3 years ago
- Sequence models in Numpyโ25Updated 4 years ago
- Code for obtaining the Curation Corpus abstractive text summarisation datasetโ127Updated 4 years ago
- Viewer for the ๐ค datasets library.โ84Updated 4 years ago
- Serving PyTorch models with TorchServeโ102Updated 2 years ago
- A tutorial on how to implement models for natural language inference using PyTorch and TorchText. [IN PROGRESS]โ26Updated 5 years ago
- State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).โ85Updated 2 years ago