Alternatives and similar repositories for MT-LM

Users that are interested in MT-LM are comparing it to the libraries listed below

• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆87Updated 3 weeks ago
• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆137Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆64Updated last year
• ymoslem / Adaptive-MT-LLM
  Adaptive Machine Translation with Large Language Models
  ☆32Updated last year
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆80Updated last week
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆107Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆110Updated last year
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆74Updated last year
• google-research-datasets / seahorse
  Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…
  ☆89Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆88Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆78Updated 2 years ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated 2 years ago
• amazon-science / wqa-multi-sentence-inference
  This repository contains code used for our Multi Sentence Inference NAACL'22 paper.
  ☆12Updated 2 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆96Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated this week
• stanford-oval / dialogues
  A unified versatile interface for dialogue datasets
  ☆18Updated 2 years ago
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆98Updated 2 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆99Updated 3 years ago
• Helsinki-NLP / OPUS-MT-testsets
  benchmarks for evaluating MT models
  ☆11Updated last year
• stanford-oval / genienlp
  GenieNLP: A versatile codebase for any NLP task
  ☆89Updated last year
• coastalcph / lexlms
  LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development
  ☆20Updated 2 years ago
• allenai / mmda
  multimodal document analysis
  ☆166Updated 2 months ago
• EleutherAI / openwebtext2
  ☆94Updated 3 years ago
• masakhane-io / afriqa
  Crosslingual Question Answering for African Languages
  ☆30Updated last year
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆70Updated 3 years ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• Breakend / PileOfLaw
  A dataset for pretraining language models targeted for legal tasks.
  ☆141Updated 3 years ago
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆23Updated last year
• ZNLP / BigTranslate
  BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
  ☆229Updated 2 years ago
• stefan-it / xlm-v-experiments
  Experiments for XLM-V Transformers Integeration
  ☆13Updated 3 years ago