explosion / tokenizationsLinks
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆193Updated 2 years ago
Alternatives and similar repositories for tokenizations
Users that are interested in tokenizations are comparing it to the libraries listed below
Sorting:
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆221Updated 2 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 4 years ago
- Easier Automatic Sentence Simplification Evaluation☆161Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆189Updated 4 years ago
- Self-Supervision for Named Entity Disambiguation at the Tail☆218Updated 3 years ago
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 2 years ago
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆78Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆146Updated 3 years ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆196Updated last month
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆88Updated 5 months ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆38Updated 3 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated last month
- A spaCy custom component that extracts and normalizes temporal expressions☆55Updated 2 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆82Updated last year
- Human-free quality estimation of document summaries☆97Updated last year
- Implementation of the ClausIE information extraction system for python+spacy☆226Updated 3 years ago
- allennlp-light is a port of AllenNLP's core modules and nn portions into a standalone package with minimum dependencies☆55Updated 3 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆101Updated last year
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆197Updated 2 years ago
- Automatically detect errors in annotated corpora.☆47Updated 2 years ago
- ☆75Updated 4 years ago
- SummVis is an interactive visualization tool for text summarization.☆253Updated 3 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- Fast computation of Krippendorff's alpha agreement measure in Python.☆152Updated 9 months ago
- The Benchmark of Linguistic Minimal Pairs☆155Updated 2 years ago
- Hyperparameter Search for AllenNLP☆139Updated 7 months ago
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆316Updated 5 years ago
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- spaCy + UDPipe☆163Updated 3 years ago