ymoslem / MT-LM
Domain-Specific Text Generation for Machine Translation (with LLMs) - scripts and config files for the paper
☆16Updated last year
Alternatives and similar repositories for MT-LM
Users that are interested in MT-LM are comparing it to the libraries listed below
Sorting:
- Open information and community for machine translation☆77Updated 3 weeks ago
- Curriculum training☆17Updated 2 months ago
- Adaptive Machine Translation with Large Language Models☆31Updated 4 months ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated last month
- A library of translation-based text similarity measures☆25Updated last year
- GEMBA — GPT Estimation Metric Based Assessment☆118Updated 9 months ago
- The FLORES+ Machine Translation Benchmark☆102Updated 6 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated 2 weeks ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆98Updated 2 years ago
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆78Updated last year
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- NTREX -- News Test References for MT Evaluation☆83Updated 11 months ago
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆78Updated last month
- A unified versatile interface for dialogue datasets☆17Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆59Updated 9 months ago
- Experiments for XLM-V Transformers Integeration☆13Updated 2 years ago
- Framework for unified summarisation and evaluation of English documents using state-of-the-art models and measures.☆32Updated last year
- a tool for calcualting character n-gram F score☆72Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆71Updated last year
- benchmarks for evaluating MT models☆12Updated 10 months ago
- Bilingual term extractor☆53Updated last year
- Bilingual sentence similarity classifier using Tensorflow☆21Updated 5 years ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- ParCourE - Parallel Corpus Explorer☆12Updated 3 years ago
- SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects☆20Updated 3 months ago
- CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed dat…☆35Updated 4 years ago
- Open source library for few shot NLP☆78Updated last year
- ☆9Updated last year