simonepri / lm-scorerLinks
📃Language Model based sentences scoring library
☆308Updated 3 years ago
Alternatives and similar repositories for lm-scorer
Users that are interested in lm-scorer are comparing it to the libraries listed below
Sorting:
- Easier Automatic Sentence Simplification Evaluation☆162Updated 2 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆384Updated 2 years ago
- A python true casing utility that restores case information for texts☆89Updated 3 years ago
- The Benchmark of Linguistic Minimal Pairs☆156Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆159Updated 2 months ago
- A tool for holistic analysis of language generations systems☆471Updated 2 months ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆223Updated 2 years ago
- Efficient Low-Memory Aligner☆146Updated 10 months ago
- Code to reproduce the experiments from the paper.☆102Updated 2 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆102Updated last year
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆347Updated 2 years ago
- ☆94Updated last year
- Open-Source Machine Translation Quality Estimation in PyTorch☆231Updated 3 years ago
- a tool for calcualting character n-gram F score☆74Updated 2 years ago
- A neural word aligner based on multilingual BERT☆359Updated 3 years ago
- One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.☆123Updated 6 years ago
- OpusFilter - Parallel corpus processing toolkit☆112Updated 3 weeks ago
- Transformer based translation quality estimation☆114Updated 2 years ago
- xfspell — the Transformer Spell Checker☆189Updated 5 years ago
- Text Simplification System and Dataset☆125Updated 2 years ago
- LASER multilingual sentence embeddings as a pip package☆225Updated 2 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…☆81Updated 4 years ago
- Scripts to preprocess training and test data and to run fast_align and giza☆107Updated 4 years ago
- Improved Sentence Alignment in Linear Time and Space☆185Updated 2 years ago
- This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…☆161Updated last year
- Build a dialog dataset from online books in many languages☆76Updated 3 years ago
- Unsupervised Statistical Machine Translation☆230Updated 5 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions o…☆103Updated last year