fe1ixxu / ALMALinks
State-of-the-art LLM-based translation models.
☆577Updated 10 months ago
Alternatives and similar repositories for ALMA
Users that are interested in ALMA are comparing it to the libraries listed below
Sorting:
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆229Updated 2 years ago
- ☆254Updated last year
- A Neural Framework for MT Evaluation☆712Updated this week
- The FLORES+ Machine Translation Benchmark☆110Updated last year
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆177Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆295Updated last week
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆90Updated 7 months ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆206Updated 2 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆95Updated 2 years ago
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆473Updated last year
- [ACL 2024] Progressive LLaMA with Block Expansion.☆514Updated last year
- Multilingual/multidomain question generation datasets, models, and python library for question generation.☆373Updated last year
- ☆57Updated 3 years ago
- Enhancing Translation with RAG-Powered Large Language Models☆89Updated last month
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆186Updated 2 months ago
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆137Updated last year
- Open language modeling toolkit based on PyTorch☆174Updated last week
- Generative Representational Instruction Tuning☆686Updated 7 months ago
- ☆564Updated last year
- Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.☆340Updated last year
- Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard☆568Updated 3 months ago
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆166Updated 7 months ago
- Library for pruning experts per language pair in NLLB-200☆34Updated 2 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated 2 years ago
- ☆132Updated 2 weeks ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆107Updated last year
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆165Updated 3 months ago
- GEMBA — GPT Estimation Metric Based Assessment☆145Updated last month
- [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia☆173Updated last year