aistairc / kirt_bert_on_abciLinks
Training BERT on ABCI
☆19Updated 4 years ago
Alternatives and similar repositories for kirt_bert_on_abci
Users that are interested in kirt_bert_on_abci are comparing it to the libraries listed below
Sorting:
- 🚀 A demonstration of hyperparameter optimization using Optuna for models implemented with AllenNLP.☆16Updated 4 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆64Updated 4 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆137Updated 2 years ago
- NanigoNet — Language detector for code-mixed input supporting 150+19 human+programming languages using deep neural networks☆72Updated 2 years ago
- ☆34Updated 5 years ago
- Code and datasets of "Multilingual Extractive Reading Comprehension by Runtime Machine Translation"☆40Updated 6 years ago
- Assorted tools and utility functions, mainly for doing NLP with Python☆24Updated last week
- Text classification with Sparse Composite Document Vectors.☆61Updated 5 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)☆78Updated 6 years ago
- PyTorch source code of NAACL 2019 paper "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"☆96Updated last year
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Updated 4 years ago
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆69Updated 4 years ago
- Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.☆51Updated 5 years ago
- Codes to pre-train Japanese T5 models☆40Updated 4 years ago
- Deliver the ready-to-train data to your NLP model.☆122Updated 3 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 5 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 2 years ago
- Hyperparameter Search for AllenNLP☆139Updated 6 months ago
- DeepThought's solution☆80Updated 2 years ago
- Train transformer-based models.☆28Updated 2 weeks ago
- Pre-training of Language Models for Language Understanding☆83Updated 6 years ago
- Source code for our AAAI 2020 paper P-SIF: Document Embeddings using Partition Averaging☆35Updated 5 years ago
- Sequence to Sequence Models in PyTorch☆44Updated last year
- A tutorial on how to implement models for natural language inference using PyTorch and TorchText. [IN PROGRESS]☆26Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆135Updated 5 years ago
- A Chainer implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆28Updated 7 years ago
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆32Updated 2 years ago
- ☆47Updated 6 years ago