ymoslem / MT-LMLinks
Domain-Specific Text Generation for Machine Translation (with LLMs) - scripts and config files for the paper
☆17Updated 2 years ago
Alternatives and similar repositories for MT-LM
Users that are interested in MT-LM are comparing it to the libraries listed below
Sorting:
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆61Updated last year
- The FLORES+ Machine Translation Benchmark☆108Updated 11 months ago
- NTREX -- News Test References for MT Evaluation☆86Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆104Updated last year
- Tools for managing datasets for governance and training.☆85Updated this week
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- Adaptive Machine Translation with Large Language Models☆31Updated 9 months ago
- Open source library for few shot NLP☆79Updated 2 years ago
- OpusFilter - Parallel corpus processing toolkit☆110Updated last week
- MAFAND-MT☆59Updated last year
- A library of translation-based text similarity measures☆25Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆86Updated 3 months ago
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆130Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆162Updated 4 months ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆73Updated last year
- Semantically Structured Sentence Embeddings☆67Updated 11 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated last year
- Curriculum training☆18Updated 3 months ago
- Efficient few-shot learning with cross-encoders.☆59Updated last year
- Crosslingual Question Answering for African Languages☆31Updated last year
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- The pipeline for the OSCAR corpus☆172Updated last year
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆79Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆31Updated last week
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Open information and community for machine translation☆80Updated this week
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆228Updated last year
- A unified versatile interface for dialogue datasets☆18Updated last year
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆99Updated 2 years ago