Kaleidophon / token2indexLinks
A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
☆51Updated 10 months ago
Alternatives and similar repositories for token2index
Users that are interested in token2index are comparing it to the libraries listed below
Sorting:
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated 7 months ago
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference☆61Updated 2 years ago
- Converter from UD-trees to BART representation☆36Updated last year
- ☆75Updated 4 years ago
- Implementation of Nested Named Entity Recognition using Flair☆24Updated 3 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- On Generating Extended Summaries of Long Documents☆78Updated 4 years ago
- A embed able annotation tool for end to end cross document co-reference☆42Updated 2 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 5 years ago
- Use BERT to Fill in the Blanks☆83Updated 3 years ago
- Custom Natural Language Processing with big and small models 🌲🌱☆66Updated 4 years ago
- Viewer for the 🤗 datasets library.☆85Updated 4 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆17Updated 5 years ago
- Code for obtaining the Curation Corpus abstractive text summarisation dataset☆127Updated 4 years ago
- numeric fused-head identification and resolution☆33Updated 6 years ago
- Preprocessing Library for Natural Language Processing☆166Updated 2 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 5 years ago
- We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval quest…☆31Updated 5 years ago
- Survey on machine learning.☆14Updated 4 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆45Updated last year
- Combining encoder-based language models☆11Updated 3 years ago
- Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …☆61Updated 5 years ago
- Data programming by demonstration for information extraction and span annotation☆35Updated 4 years ago
- 🐸 KERMIT - A lightweight library to encode and interpret Universal Syntactic Embeddings☆58Updated 2 years ago
- A generic library for crafting adversarial NLP examples - WIP☆41Updated 6 years ago
- A text augmentation tool for named entity recognition.☆54Updated 4 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 2 years ago
- Open source library for few shot NLP☆78Updated 2 years ago