hplt-project / sacremosesLinks
Python port of Moses tokenizer, truecaser and normalizer
☆495Updated last year
Alternatives and similar repositories for sacremoses
Users that are interested in sacremoses are comparing it to the libraries listed below
Sorting:
- Simple, fast unsupervised word aligner☆758Updated 3 years ago
- Fast BPE☆678Updated last year
- A tool for holistic analysis of language generations systems☆472Updated last month
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆378Updated last year
- Open-Source Machine Translation Quality Estimation in PyTorch☆231Updated 3 years ago
- Unsupervised Statistical Machine Translation☆229Updated 5 years ago
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆451Updated last year
- A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.☆317Updated 2 months ago
- A neural word aligner based on multilingual BERT☆358Updated 3 years ago
- A framework to learn cross-lingual word embedding mappings☆649Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Updated last year
- High-accuracy NLP parser with models for 11 languages.☆897Updated 3 years ago
- Byte Pair Encoding for Python!☆231Updated 3 years ago
- LASER multilingual sentence embeddings as a pip package☆225Updated 2 years ago
- Evaluating Cross-lingual Sentence Representations☆458Updated 4 years ago
- Easier Automatic Sentence Simplification Evaluation☆161Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆158Updated last month
- Resources for the NAACL 2018 paper "A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents"☆382Updated 2 years ago
- 📃Language Model based sentences scoring library☆309Updated 3 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆347Updated 2 years ago
- This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…☆561Updated 3 years ago
- JFLEG (JHU FLuency-Extended GUG) corpus for Grammatical Error Correction Evaluation☆113Updated 2 years ago
- Efficient Low-Memory Aligner☆146Updated 9 months ago
- Bitextor generates translation memories from multilingual websites☆296Updated 11 months ago
- Improved Sentence Alignment in Linear Time and Space☆184Updated 2 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆231Updated 4 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆221Updated 2 years ago
- Transformer based translation quality estimation☆114Updated 2 years ago
- Large corpus of uncompressed and compressed sentences from news articles.☆125Updated 8 years ago
- A Python wrapper for the ROUGE summarization evaluation package☆249Updated 4 years ago