timoschick / one-token-approximationLinks
This repository contains the code for applying One-Token Approximation to a pretrained language model using subword-level tokenization.
☆11Updated 5 years ago
Alternatives and similar repositories for one-token-approximation
Users that are interested in one-token-approximation are comparing it to the libraries listed below
Sorting:
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Updated 3 years ago
- Code and data for: Low Resource Grammatical Error Correction Using Wikipedia Edits (WNUT 2018)☆16Updated 10 months ago
- RelEx - A simple framework for Relation Extraction built on AllenNLP☆16Updated 4 years ago
- ☆25Updated last year
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 4 years ago
- EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering☆38Updated 3 years ago
- ☆24Updated 5 years ago
- ☆46Updated 5 years ago
- ☆20Updated 4 years ago
- A coreference evaluation package for the CoNLL and ARRAU datasets☆40Updated 4 years ago
- ☆24Updated last year
- We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval quest…☆31Updated 4 years ago
- Analyzing mBERT's multilinguality in a small laboratory setting☆13Updated last year
- Cross-lingual TRansfer Evaluation of Multilingual Encoders (XTREME)☆22Updated 5 years ago
- ☆31Updated 4 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆66Updated 3 years ago
- Automatically detect errors in annotated corpora.☆47Updated last year
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated 2 years ago
- ACL'2020: Contextualized Sparse Representations for Real-Time Open-Domain Question Answering☆49Updated 4 years ago
- ☆13Updated 4 years ago
- codebase for the Text-based NP Enrichment (TNE) paper☆20Updated last year
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 4 years ago
- Tool to perform paired evaluation of automatic systems☆12Updated 3 years ago
- Frame-Semantic and PropBank Semantic Role Labeling with Syntactic Scaffolding.☆50Updated 3 years ago
- Research into identifying and correcting incorrect labels in the CoNLL-2003 corpus.☆12Updated 4 years ago
- A template for starting an allennlp project using a python script instead of config files☆27Updated last year
- ☆25Updated 3 years ago
- The NLPStatTest project☆12Updated 3 years ago
- End-to-end shallow discourse parser☆21Updated last year
- ☆16Updated 4 years ago