explosion / tokenizations
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆190Updated last year
Alternatives and similar repositories for tokenizations:
Users that are interested in tokenizations are comparing it to the libraries listed below
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆142Updated 2 years ago
- Implementation of the ClausIE information extraction system for python+spacy☆221Updated 2 years ago
- Easier Automatic Sentence Simplification Evaluation☆160Updated last year
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆68Updated 3 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆97Updated 11 months ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆84Updated 2 weeks ago
- Self-Supervision for Named Entity Disambiguation at the Tail☆215Updated 2 years ago
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆301Updated 4 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- A spaCy wrapper for DBpedia Spotlight☆109Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆222Updated 2 years ago
- An Interactive Tool for Scalable and Reproducible Error Analysis.☆106Updated 3 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆205Updated last year
- Automatically detect errors in annotated corpora.☆47Updated last year
- ☆75Updated 3 years ago
- ☆228Updated 3 years ago
- The Benchmark of Linguistic Minimal Pairs☆149Updated 2 years ago
- Hyperparameter Search for AllenNLP☆137Updated 2 weeks ago
- Human-free quality estimation of document summaries☆97Updated 7 months ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆171Updated 4 months ago
- spaCy + UDPipe☆161Updated 2 years ago
- Pytorch implementation of Highly Parallel Autoregressive Entity Linking with Discriminative Correction☆67Updated 2 years ago
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆107Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆151Updated 10 months ago
- Language Modelling Makes Sense - WSD (and more) with Contextual Embeddings☆95Updated last year
- [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction☆119Updated 3 years ago
- SummVis is an interactive visualization tool for text summarization.☆252Updated 2 years ago