Alternatives and similar repositories for MT-LM

Users that are interested in MT-LM are comparing it to the libraries listed below

• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆130Updated 11 months ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆83Updated 3 weeks ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆57Updated last year
• ymoslem / Adaptive-MT-LLM
  Adaptive Machine Translation with Large Language Models
  ☆31Updated 8 months ago
• hetpandya / paraphrase-datasets-pretrained-models
  A collection of preprocessed datasets and pretrained models for generating paraphrases.
  ☆30Updated 4 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆108Updated 9 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆60Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆79Updated 2 years ago
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆80Updated this week
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆57Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• ZNLP / BigTranslate
  BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
  ☆228Updated last year
• stanford-oval / dialogues
  A unified versatile interface for dialogue datasets
  ☆18Updated last year
• alirezamshi-zz / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆23Updated 2 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• google-research-datasets / seahorse
  Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…
  ☆89Updated last year
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆85Updated last month
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• nicolay-r / AREkit
  Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML
  ☆63Updated 7 months ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆85Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆109Updated 3 weeks ago
• mukhal / PromptRank
  [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Prompting
  ☆27Updated 2 years ago
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆97Updated 2 years ago
• google-research / url-nlp
  ☆219Updated last month
• Helsinki-NLP / OPUS-MT-testsets
  benchmarks for evaluating MT models
  ☆12Updated last year
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆67Updated 10 months ago
• SkBlaz / rakun2
  RaKUn 2.0 - A fast keyword detection algorithm
  ☆68Updated last month
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆22Updated 7 months ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated 9 months ago