helpmefindaname / transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
☆22Updated 7 months ago
Alternatives and similar repositories for transformer-smaller-training-vocab:
Users that are interested in transformer-smaller-training-vocab are comparing it to the libraries listed below
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Updated 2 years ago
- zero-vocab or low-vocab embeddings☆18Updated 2 years ago
- ☆26Updated 6 months ago
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Updated last year
- Tool for parsing and converting various span encoding schemes.☆22Updated last year
- Automatically detect errors in annotated corpora.☆47Updated last year
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆51Updated 2 months ago
- ☆12Updated 3 years ago
- ☆74Updated 3 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆18Updated 4 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- GC4LM: A Colossal (Biased) language model for German☆13Updated 3 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆83Updated last week
- Combining encoder-based language models☆11Updated 3 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)☆14Updated 7 months ago
- A software for transferring pre-trained English models to foreign languages☆18Updated last year
- A spaCy custom component that extracts and normalizes temporal expressions☆54Updated 2 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 8 months ago
- ☆42Updated last year
- Experiments with Zalando's flair library☆34Updated last year
- COMBO is jointly trained tagger, lemmatizer and dependency parser.☆35Updated last year
- ☆64Updated 2 years ago
- Converter from UD-trees to BART representation☆36Updated 11 months ago
- Simple library to work with pre-trained ELMo models in TensorFlow☆52Updated last year
- An implementation of GrASP (Shnarch et. al., 2017)☆21Updated 2 years ago
- Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'☆17Updated 2 years ago
- Data programming by demonstration for information extraction and span annotation☆35Updated 3 years ago
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 4 years ago
- PyTorch-IE: State-of-the-art Information Extraction in PyTorch☆77Updated last week