explosion / tokenizationsLinks
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆192Updated last year
Alternatives and similar repositories for tokenizations
Users that are interested in tokenizations are comparing it to the libraries listed below
Sorting:
- Easier Automatic Sentence Simplification Evaluation☆161Updated last year
- A python true casing utility that restores case information for texts☆88Updated 2 years ago
- Implementation of the ClausIE information extraction system for python+spacy☆222Updated 2 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆143Updated 2 years ago
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆99Updated last year
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆87Updated 2 weeks ago
- Hyperparameter Search for AllenNLP☆139Updated 2 months ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- Automatically detect errors in annotated corpora.☆47Updated last year
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆195Updated 2 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 3 years ago
- spaCy + UDPipe☆161Updated 3 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆222Updated 2 years ago
- ☆76Updated 3 years ago
- Self-Supervision for Named Entity Disambiguation at the Tail☆218Updated 2 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆208Updated last year
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆78Updated 2 years ago
- CrossWeigh: Training Named Entity Tagger from Imperfect Annotations☆177Updated 10 months ago
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆307Updated 5 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆155Updated last year
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆180Updated this week
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆108Updated 3 years ago
- The Benchmark of Linguistic Minimal Pairs☆150Updated 2 years ago
- ☆29Updated 3 years ago
- An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the t…☆222Updated 11 months ago
- Human-free quality estimation of document summaries☆97Updated 10 months ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆122Updated last year