Whiax / BERT-Transformer-Pytorch
Basic implementation of BERT and Transformer in Pytorch in one short python file (also includes "predict next word" GPT task)
☆41Updated last year
Alternatives and similar repositories for BERT-Transformer-Pytorch:
Users that are interested in BERT-Transformer-Pytorch are comparing it to the libraries listed below
- Implementation of the GBST block from the Charformer paper, in Pytorch☆117Updated 3 years ago
- Some notebooks for NLP☆194Updated last year
- Minimal implementation of Multi-layer Recurrent Neural Networks (LSTM) for character-level language modelling in PyTorch☆46Updated 5 years ago
- ☆64Updated 4 years ago
- Personal implementation of the Transformer paper.☆22Updated last year
- Checkout the new version at the link!☆22Updated 4 years ago
- pytorch; mask language model ; bert☆72Updated 5 years ago
- ☆34Updated 4 years ago
- A repository containing the code for the Bistable Recurrent Cell☆47Updated 4 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆178Updated last year
- ☆46Updated 4 years ago
- German small and large versions of GPT2.☆20Updated 2 years ago
- A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch☆221Updated last year
- Use Language Model (LM) for Grammar Error Correction (GEC), without the use of annotated data.☆83Updated 5 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆80Updated 2 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆134Updated 3 years ago
- NLP Examples using the 🤗 libraries☆41Updated 4 years ago
- Usage of Siamese Recurrent Neural network architectures for semantic textual similarity☆22Updated 5 years ago
- Code for "Finetuning Pretrained Transformers into Variational Autoencoders"☆37Updated 2 years ago
- A tutorial on how to implement models for natural language inference using PyTorch and TorchText. [IN PROGRESS]☆25Updated 4 years ago
- Fine-tune transformers with pytorch-lightning☆44Updated 2 years ago
- LTG-Bert☆29Updated last year
- Language Modeling Example with Transformers and PyTorch Lighting☆65Updated 4 years ago
- An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.☆132Updated 5 years ago
- Low-code pre-built pipelines for experiments with huggingface/transformers for Data Scientists in a rush.☆16Updated 4 years ago
- ☆207Updated 10 months ago
- RNN Encoder-Decoder in PyTorch☆42Updated 6 months ago
- Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers☆48Updated last year
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆326Updated last year