ZNLP / BigTranslate
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
☆221Updated last year
Alternatives and similar repositories for BigTranslate:
Users that are interested in BigTranslate are comparing it to the libraries listed below
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆172Updated last month
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 9 months ago
- ☆238Updated 8 months ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆111Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆185Updated last year
- State-of-the-art LLM-based translation models.☆484Updated 3 weeks ago
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆241Updated last year
- ☆152Updated last year
- The FLORES+ Machine Translation Benchmark☆100Updated 3 months ago
- Enhancing Translation with RAG-Powered Large Language Models☆74Updated last month
- Unofficial implementation of AlpaGasus☆90Updated last year
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆75Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆116Updated 5 months ago
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆117Updated 4 months ago
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated last year
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆185Updated 2 weeks ago
- ☆57Updated 2 years ago
- Open language modeling toolkit based on PyTorch☆84Updated this week
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆267Updated 3 weeks ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆208Updated 11 months ago
- ☆77Updated last year
- The pipeline for the OSCAR corpus☆166Updated last year
- ☆182Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Scripts for fine-tuning Llama2 via SFT and DPO.☆194Updated last year
- ☆14Updated 9 months ago
- ☆122Updated last year