explosion / tokenizationsLinks
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆192Updated last year
Alternatives and similar repositories for tokenizations
Users that are interested in tokenizations are comparing it to the libraries listed below
Sorting:
- Easier Automatic Sentence Simplification Evaluation☆162Updated last year
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆223Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- Self-Supervision for Named Entity Disambiguation at the Tail☆218Updated 3 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago
- ☆196Updated 3 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆197Updated 2 years ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆182Updated last week
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆204Updated 3 years ago
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆78Updated 2 years ago
- Implementation of the ClausIE information extraction system for python+spacy☆224Updated 2 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆87Updated last month
- New dataset☆305Updated 3 years ago
- [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction☆119Updated 3 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆208Updated last year
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 3 years ago
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆182Updated 3 years ago
- Hyperparameter Search for AllenNLP☆139Updated 4 months ago
- SummVis is an interactive visualization tool for text summarization.☆253Updated 3 years ago
- A multilingual version of MS MARCO passage ranking dataset☆145Updated last year
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆307Updated 5 years ago
- ☆76Updated 4 years ago
- a tool for calcualting character n-gram F score☆73Updated 2 years ago
- Code for the CRAC 2021 paper "On Generalization in Coreference Resolution" (Best short paper award)☆35Updated last year
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆395Updated last year
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆108Updated 3 years ago
- The Benchmark of Linguistic Minimal Pairs☆152Updated 2 years ago