Kaleidophon / token2indexLinks
A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
☆51Updated 5 months ago
Alternatives and similar repositories for token2index
Users that are interested in token2index are comparing it to the libraries listed below
Sorting:
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated 2 months ago
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- ☆76Updated 3 years ago
- pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference☆62Updated 2 years ago
- A program to choose transfer languages for cross-lingual learning☆72Updated 2 years ago
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Updated 2 years ago
- numeric fused-head identification and resolution☆33Updated 5 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- Converter from UD-trees to BART representation☆36Updated last year
- Neural-IR-Explorer: A Content-Focused Tool to Explore Neural Re-Ranking Results☆32Updated 5 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 11 months ago
- A python tool for building large scale Wikipedia-based Information Retrieval datasets☆46Updated 4 years ago
- The accompanying code for "Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understandin…☆21Updated 5 years ago
- Massively Multilingual Transfer for NER☆86Updated 3 years ago
- ☆64Updated 2 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- A Benchmark Dataset for Understanding Disfluencies in Question Answering☆62Updated 3 years ago
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆108Updated 3 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆18Updated 5 years ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆48Updated 3 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- Viewer for the 🤗 datasets library.☆84Updated 3 years ago
- Data programming by demonstration for information extraction and span annotation☆35Updated 3 years ago
- A coreference evaluation package for the CoNLL and ARRAU datasets☆40Updated 4 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- ☆33Updated 3 years ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries☆19Updated 3 years ago
- A embed able annotation tool for end to end cross document co-reference☆42Updated 2 years ago
- jiant-dev☆28Updated 4 years ago
- Frame-Semantic and PropBank Semantic Role Labeling with Syntactic Scaffolding.☆50Updated 3 years ago