Alternatives and similar repositories for ALMA

Users that are interested in ALMA are comparing it to the libraries listed below

• ZNLP / BigTranslate
  BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
  ☆229Updated 2 years ago
• hsing-wang / Awesome-LLM-MT
  ☆254Updated last year
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆697Updated 4 months ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆287Updated 2 months ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆109Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆206Updated 2 years ago
• eole-nlp / eole
  Open language modeling toolkit based on PyTorch
  ☆161Updated last week
• wxjiao / ParroT
  The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…
  ☆176Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆96Updated 2 years ago
• naver / nllb-pruning
  Library for pruning experts per language pair in NLLB-200
  ☆34Updated 2 years ago
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆90Updated 5 months ago
• rayliuca / T-Ragx
  Enhancing Translation with RAG-Powered Large Language Models
  ☆88Updated last month
• TencentARC / LLaMA-Pro
  [ACL 2024] Progressive LLaMA with Block Expansion.
  ☆514Updated last year
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆338Updated last year
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆181Updated last month
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆134Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆471Updated last year
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆635Updated last year
• huggingface / cosmopedia
  ☆559Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆106Updated last year
• pluiez / NLLB-inference
  ☆57Updated 3 years ago
• jondurbin / bagel
  A bagel, with everything.
  ☆325Updated last year
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆518Updated 11 months ago
• ChenghaoMou / text-dedup
  All-in-one text de-duplication
  ☆737Updated this week
• MicrosoftTranslator / GEMBA
  GEMBA — GPT Estimation Metric Based Assessment
  ☆138Updated 2 weeks ago
• wmt-conference / wmt23-news-systems
  ☆14Updated 2 months ago
• google-research / metricx
  ☆119Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆482Updated last year
• fzp0424 / self_correct_mt
  [NAACL'25] TEaR framework for paper "TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement"
  ☆49Updated last year