Kaleidophon / token2indexLinks
A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
☆51Updated 7 months ago
Alternatives and similar repositories for token2index
Users that are interested in token2index are comparing it to the libraries listed below
Sorting:
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated 4 months ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Updated 2 years ago
- On Generating Extended Summaries of Long Documents☆78Updated 4 years ago
- A embed able annotation tool for end to end cross document co-reference☆42Updated 2 years ago
- Use BERT to Fill in the Blanks☆83Updated 3 years ago
- Implementation of Nested Named Entity Recognition using Flair☆24Updated 3 years ago
- ☆76Updated 4 years ago
- pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference☆62Updated 2 years ago
- reference pytorch code for intent classification☆44Updated 8 months ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 4 years ago
- "Zero-Training Sentence Embedding via Orthogonal Basis" paper implementation☆19Updated 6 years ago
- Converter from UD-trees to BART representation☆36Updated last year
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆32Updated last year
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆77Updated 2 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated last year
- numeric fused-head identification and resolution☆33Updated 5 years ago
- Data programming by demonstration for information extraction and span annotation☆35Updated 3 years ago
- Custom Natural Language Processing with big and small models 🌲🌱☆68Updated 3 years ago
- Source code for our AAAI 2020 paper P-SIF: Document Embeddings using Partition Averaging☆34Updated 5 years ago
- Neural-IR-Explorer: A Content-Focused Tool to Explore Neural Re-Ranking Results☆32Updated 5 years ago
- KitanaQA: Adversarial training and data augmentation for neural question-answering models☆57Updated last year
- Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …☆60Updated 4 years ago
- Train transformer-based models.☆28Updated 2 months ago
- Viewer for the 🤗 datasets library.☆84Updated 3 years ago
- Generative Retrieval Transformer☆28Updated last year
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆69Updated 4 years ago
- Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.☆51Updated 5 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆17Updated 5 years ago