Kaleidophon / token2index
A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
☆51Updated 3 months ago
Alternatives and similar repositories for token2index:
Users that are interested in token2index are comparing it to the libraries listed below
- numeric fused-head identification and resolution☆33Updated 5 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 9 months ago
- A embed able annotation tool for end to end cross document co-reference☆41Updated 2 years ago
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated 2 weeks ago
- Converter from UD-trees to BART representation☆36Updated last year
- A program to choose transfer languages for cross-lingual learning☆72Updated last year
- ☆75Updated 3 years ago
- pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference☆62Updated 2 years ago
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Updated 2 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- Neural-IR-Explorer: A Content-Focused Tool to Explore Neural Re-Ranking Results☆33Updated 5 years ago
- A collection of selected of models built with AllenNLP.☆25Updated 5 years ago
- codebase for the Text-based NP Enrichment (TNE) paper☆20Updated last year
- EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering☆38Updated 3 years ago
- ☆64Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- Frame-Semantic and PropBank Semantic Role Labeling with Syntactic Scaffolding.☆50Updated 3 years ago
- a Fairseq fork for sequence tagging/labeling tasks☆31Updated 4 years ago
- ☆33Updated 3 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated 10 months ago
- reference pytorch code for intent classification☆44Updated 5 months ago
- Formate converter from one type of qa task datasets to another type☆39Updated 6 years ago
- Efficient Sentence Embedding via Semantic Subspace Analysis☆14Updated 5 years ago
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 4 years ago
- Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluation☆63Updated 6 years ago
- Tools for training pytorch language models☆27Updated 4 years ago
- ☆17Updated 2 years ago
- ☆16Updated last year