fe1ixxu / ALMALinks
State-of-the-art LLM-based translation models.
☆566Updated 8 months ago
Alternatives and similar repositories for ALMA
Users that are interested in ALMA are comparing it to the libraries listed below
Sorting:
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆229Updated 2 years ago
- ☆252Updated last year
- A Neural Framework for MT Evaluation☆687Updated 3 months ago
- The FLORES+ Machine Translation Benchmark☆109Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆287Updated last month
- Open language modeling toolkit based on PyTorch☆159Updated last week
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆94Updated 2 years ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆205Updated 2 years ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆514Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆175Updated 3 weeks ago
- Enhancing Translation with RAG-Powered Large Language Models☆87Updated 3 weeks ago
- Library for pruning experts per language pair in NLLB-200☆34Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆164Updated 5 months ago
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆470Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆89Updated 5 months ago
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆176Updated 11 months ago
- ☆556Updated last year
- ☆118Updated last year
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆795Updated 8 months ago
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆161Updated last month
- DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI☆517Updated 10 months ago
- Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard☆566Updated last month
- Official repository for ORPO☆467Updated last year
- ☆57Updated 3 years ago
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆632Updated last year
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆133Updated last year
- Generative Representational Instruction Tuning☆679Updated 5 months ago
- FuseAI Project☆583Updated 10 months ago
- Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.☆338Updated 11 months ago