simonepri / lm-scorerLinks
πLanguage Model based sentences scoring library
β308Updated 3 years ago
Alternatives and similar repositories for lm-scorer
Users that are interested in lm-scorer are comparing it to the libraries listed below
Sorting:
- Easier Automatic Sentence Simplification Evaluationβ165Updated 2 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)β385Updated 2 years ago
- A python true casing utility that restores case information for textsβ89Updated 3 years ago
- A tool for holistic analysis of language generations systemsβ471Updated 2 months ago
- The Benchmark of Linguistic Minimal Pairsβ159Updated 3 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)β347Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corporaβ159Updated 3 months ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphologyβ¦β223Updated 2 years ago
- Easily fine tune GPT-2 to fill in missing textβ201Updated 3 years ago
- Code to reproduce the experiments from the paper.β103Updated 2 years ago
- Build a dialog dataset from online books in many languagesβ76Updated 3 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasingβ102Updated last year
- This repository contains the code for "Generating Datasets with Pretrained Language Models".β189Updated 4 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.β159Updated last year
- Efficient Low-Memory Alignerβ146Updated 11 months ago
- a tool for calcualting character n-gram F scoreβ74Updated 2 years ago
- Automatic extraction of edited sentences from text edition histories.β83Updated 3 years ago
- xfspell β the Transformer Spell Checkerβ189Updated 5 years ago
- Transformer based translation quality estimationβ114Updated 2 years ago
- Switchboard Dialog Act Corpus with Penn Treebank linksβ146Updated 4 years ago
- Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/β193Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.β148Updated 3 years ago
- A neural word aligner based on multilingual BERTβ361Updated 3 years ago
- GeDi: Generative Discriminator Guided Sequence Generationβ210Updated 6 months ago
- Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models β¦β231Updated 2 years ago
- LASER multilingual sentence embeddings as a pip packageβ225Updated 2 years ago
- New datasetβ310Updated 4 years ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".β100Updated 2 years ago
- Scripts to preprocess training and test data and to run fast_align and gizaβ107Updated 4 years ago
- Unsupervised Statistical Machine Translationβ230Updated 5 years ago