simonepri / lm-scorerLinks
πLanguage Model based sentences scoring library
β308Updated 3 years ago
Alternatives and similar repositories for lm-scorer
Users that are interested in lm-scorer are comparing it to the libraries listed below
Sorting:
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)β383Updated 2 years ago
- Easier Automatic Sentence Simplification Evaluationβ162Updated 2 years ago
- The Benchmark of Linguistic Minimal Pairsβ157Updated 2 years ago
- A python true casing utility that restores case information for textsβ89Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corporaβ159Updated last month
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphologyβ¦β222Updated 2 years ago
- Code to reproduce the experiments from the paper.β102Updated 2 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasingβ102Updated last year
- A tool for holistic analysis of language generations systemsβ471Updated last month
- A neural word aligner based on multilingual BERTβ359Updated 3 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)β348Updated 2 years ago
- Transformer based translation quality estimationβ114Updated 2 years ago
- One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.β123Updated 6 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.β160Updated last year
- GeDi: Generative Discriminator Guided Sequence Generationβ209Updated 4 months ago
- Easily fine tune GPT-2 to fill in missing textβ201Updated 2 years ago
- A simple library for querying the URIEL typological database.β92Updated last year
- Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models β¦β231Updated 2 years ago
- Automatic extraction of edited sentences from text edition histories.β83Updated 3 years ago
- Efficient Low-Memory Alignerβ145Updated 9 months ago
- [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correctionβ120Updated 4 years ago
- Switchboard Dialog Act Corpus with Penn Treebank linksβ146Updated 4 years ago
- We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scalβ¦β81Updated 4 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.β146Updated 3 years ago
- Open-Source Machine Translation Quality Estimation in PyTorchβ231Updated 3 years ago
- Scripts to preprocess training and test data and to run fast_align and gizaβ108Updated 4 years ago
- a tool for calcualting character n-gram F scoreβ74Updated 2 years ago
- Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions oβ¦β103Updated last year
- This repository contains the code for "Generating Datasets with Pretrained Language Models".β189Updated 4 years ago
- LASER multilingual sentence embeddings as a pip packageβ225Updated 2 years ago