explosion / tokenizationsLinks
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆193Updated 2 years ago
Alternatives and similar repositories for tokenizations
Users that are interested in tokenizations are comparing it to the libraries listed below
Sorting:
- Easier Automatic Sentence Simplification Evaluation☆161Updated 2 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆223Updated 2 years ago
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 4 years ago
- Self-Supervision for Named Entity Disambiguation at the Tail☆219Updated 3 years ago
- Implementation of the ClausIE information extraction system for python+spacy☆224Updated 3 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 weeks ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆192Updated last month
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆145Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 2 years ago
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆78Updated 2 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆69Updated 4 years ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆197Updated 2 years ago
- ☆75Updated 4 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆82Updated last year
- A spaCy custom component that extracts and normalizes temporal expressions☆55Updated 2 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆88Updated 4 months ago
- A multilingual version of MS MARCO passage ranking dataset☆144Updated last year
- 🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy☆321Updated 5 months ago
- Automatically detect errors in annotated corpora.☆47Updated 2 years ago
- Human-free quality estimation of document summaries☆97Updated last year
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆376Updated last year
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆314Updated 5 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆101Updated last year
- DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models☆154Updated 2 years ago
- allennlp-light is a port of AllenNLP's core modules and nn portions into a standalone package with minimum dependencies☆57Updated 2 years ago
- Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"☆201Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- Repo for Aspire - A scientific document similarity model based on matching fine-grained aspects of scientific papers.☆54Updated 2 years ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆38Updated 3 years ago