timoschick / one-token-approximationLinks
This repository contains the code for applying One-Token Approximation to a pretrained language model using subword-level tokenization.
☆11Updated 5 years ago
Alternatives and similar repositories for one-token-approximation
Users that are interested in one-token-approximation are comparing it to the libraries listed below
Sorting:
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Updated 4 years ago
- EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering☆38Updated 4 years ago
- ☆46Updated 5 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 5 years ago
- We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval quest…☆31Updated 5 years ago
- The NLPStatTest project☆12Updated 3 years ago
- Code and data for the paper "Soft Gazetteers for Low-resource Named Entity Recognition"☆19Updated 5 years ago
- Hyperparameter Search for AllenNLP☆140Updated 9 months ago
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 5 years ago
- ☆75Updated 4 years ago
- ☆13Updated 4 years ago
- Codebase for probing and visualizing multilingual models.☆49Updated 5 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆95Updated 3 years ago
- Code to reproduce the experiments from the paper.☆103Updated 2 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆87Updated 6 months ago
- A coreference evaluation package for the CoNLL and ARRAU datasets☆41Updated 5 years ago
- ☆68Updated 7 months ago
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆80Updated 4 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Updated 4 years ago
- ☆32Updated 4 years ago
- Tool to perform paired evaluation of automatic systems☆13Updated 4 years ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆26Updated 4 years ago
- Pytorch implementation of Highly Parallel Autoregressive Entity Linking with Discriminative Correction☆67Updated 3 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 4 years ago
- 🐸 KERMIT - A lightweight library to encode and interpret Universal Syntactic Embeddings☆58Updated 2 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Updated 2 months ago
- ☆92Updated 4 years ago
- State of the art Semantic Sentence Embeddings☆99Updated 3 years ago
- GMEG☆31Updated last year
- Code for our TSD paper "TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models"☆14Updated 3 years ago