ZNLP / BigTranslateLinks
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
☆227Updated last year
Alternatives and similar repositories for BigTranslate
Users that are interested in BigTranslate are comparing it to the libraries listed below
Sorting:
- State-of-the-art LLM-based translation models.☆539Updated 3 months ago
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆176Updated 6 months ago
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆185Updated 2 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆93Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆209Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Updated last year
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆127Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆94Updated 2 years ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- ☆242Updated last year
- The FLORES+ Machine Translation Benchmark☆106Updated 8 months ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆81Updated last year
- Crosslingual Generalization through Multitask Finetuning☆538Updated 9 months ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 5 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆103Updated last year
- ☆157Updated last year
- Unofficial implementation of AlpaGasus☆92Updated last year
- Simple, hackable and fast implementation for training/finetuning medium-sized LLaMA-based models☆176Updated this week
- ☆458Updated last year
- SAIL: Search Augmented Instruction Learning☆157Updated 2 years ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆200Updated last year
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆126Updated 9 months ago
- All available datasets for Instruction Tuning of Large Language Models☆254Updated last year
- Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"☆99Updated last year
- DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI☆507Updated 5 months ago
- ☆57Updated 3 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆184Updated this week
- Multilingual Large Language Models Evaluation Benchmark☆126Updated 10 months ago
- ☆180Updated 2 years ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆280Updated 5 months ago