ZNLP / BigTranslateLinks
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
☆229Updated 2 years ago
Alternatives and similar repositories for BigTranslate
Users that are interested in BigTranslate are comparing it to the libraries listed below
Sorting:
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆176Updated last year
- State-of-the-art LLM-based translation models.☆577Updated 9 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆96Updated 2 years ago
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆184Updated 2 years ago
- ☆254Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- The FLORES+ Machine Translation Benchmark☆109Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆209Updated 2 years ago
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆135Updated last year
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆135Updated 2 years ago
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆79Updated 2 years ago
- Datasets for Instruction Tuning of Large Language Models☆260Updated 2 years ago
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated 2 years ago
- DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI☆519Updated 11 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆107Updated last year
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆190Updated 11 months ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆216Updated last year
- Crosslingual Generalization through Multitask Finetuning☆537Updated last year
- GEMBA — GPT Estimation Metric Based Assessment☆141Updated last month
- ☆35Updated 2 years ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆294Updated last week
- Unofficial implementation of AlpaGasus☆94Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca☆98Updated 2 years ago
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆228Updated 2 years ago
- A Multi-Turn Dialogue Corpus based on Alpaca Instructions☆178Updated 2 years ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆207Updated 2 years ago
- OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA☆304Updated 2 years ago
- ☆123Updated 2 years ago