explosion / tokenizationsLinks
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆192Updated last year
Alternatives and similar repositories for tokenizations
Users that are interested in tokenizations are comparing it to the libraries listed below
Sorting:
- Self-Supervision for Named Entity Disambiguation at the Tail☆219Updated 3 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆223Updated 2 years ago
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆78Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 3 years ago
- Easier Automatic Sentence Simplification Evaluation☆161Updated last year
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆183Updated 3 weeks ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆87Updated 2 months ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆81Updated last year
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆197Updated 2 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆100Updated last year
- Implementation of the ClausIE information extraction system for python+spacy☆225Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- Human-free quality estimation of document summaries☆97Updated last year
- Fast computation of Krippendorff's alpha agreement measure in Python.☆148Updated 6 months ago
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆310Updated 5 years ago
- ☆75Updated 4 years ago
- Hyperparameter Search for AllenNLP☆139Updated 4 months ago
- Text tokenization and sentence segmentation (segtok v2)☆205Updated 3 years ago
- A python module for word inflections designed for use with spaCy.☆92Updated 5 years ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆38Updated 3 years ago
- Automatically detect errors in annotated corpora.☆47Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- New dataset☆306Updated 3 years ago
- spaCy + UDPipe☆162Updated 3 years ago
- allennlp-light is a port of AllenNLP's core modules and nn portions into a standalone package with minimum dependencies☆57Updated 2 years ago
- Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"☆201Updated last year