explosion / tokenizations
Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
☆190Updated last year
Alternatives and similar repositories for tokenizations:
Users that are interested in tokenizations are comparing it to the libraries listed below
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆140Updated 2 years ago
- Easier Automatic Sentence Simplification Evaluation☆160Updated last year
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆221Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆83Updated last week
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆96Updated 9 months ago
- Hyperparameter Search for AllenNLP☆135Updated last month
- Implementation of the ClausIE information extraction system for python+spacy☆220Updated 2 years ago
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆65Updated 2 years ago
- ☆228Updated 3 years ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆68Updated 3 years ago
- Framework for weakly supervised deep sequence taggers, focused on named entity recognition☆79Updated 2 years ago
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆107Updated 2 years ago
- Multi-hop dense retrieval for question answering☆213Updated 3 years ago
- A python true casing utility that restores case information for texts☆88Updated 2 years ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆168Updated 3 years ago
- spaCy + UDPipe☆160Updated 2 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆175Updated last year
- ☆74Updated 3 years ago
- Text tokenization and sentence segmentation (segtok v2)☆201Updated 2 years ago
- The Benchmark of Linguistic Minimal Pairs☆148Updated 2 years ago
- 🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy☆309Updated last year
- Self-Supervision for Named Entity Disambiguation at the Tail☆215Updated 2 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- A python library that makes AMR parsing, generation and visualization simple.☆234Updated last year
- Automatically detect errors in annotated corpora.☆47Updated last year
- SummVis is an interactive visualization tool for text summarization.☆252Updated 2 years ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆168Updated 3 months ago