ZNLP / BigTranslate
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
☆221Updated last year
Alternatives and similar repositories for BigTranslate:
Users that are interested in BigTranslate are comparing it to the libraries listed below
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆176Updated 3 months ago
- State-of-the-art LLM-based translation models.☆512Updated 2 months ago
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆119Updated 6 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated 11 months ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆184Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆90Updated last year
- ☆243Updated 10 months ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆271Updated 2 months ago
- The FLORES+ Machine Translation Benchmark☆101Updated 5 months ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆209Updated last year
- Crosslingual Generalization through Multitask Finetuning☆530Updated 6 months ago
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆121Updated 7 months ago
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆76Updated last year
- Multilingual sentence alignment using sentence embeddings☆113Updated 5 months ago
- Unofficial implementation of AlpaGasus☆90Updated last year
- ☆76Updated last year
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated last year
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 2 months ago
- An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.☆300Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆309Updated 2 years ago
- A Multi-Turn Dialogue Corpus based on Alpaca Instructions☆168Updated last year
- ☆307Updated 10 months ago
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆56Updated last year
- ☆57Updated 2 years ago
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆122Updated last year
- Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"☆100Updated 9 months ago