ZNLP / BigTranslateLinks
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
☆225Updated last year
Alternatives and similar repositories for BigTranslate
Users that are interested in BigTranslate are comparing it to the libraries listed below
Sorting:
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆174Updated 5 months ago
- State-of-the-art LLM-based translation models.☆529Updated last month
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆185Updated last year
- The FLORES+ Machine Translation Benchmark☆104Updated 6 months ago
- ☆243Updated last year
- ☆57Updated 2 years ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆209Updated last year
- ☆124Updated last year
- MultilingualShareGPT, the free multi-language corpus for LLM training☆72Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆101Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆122Updated 9 months ago
- Crosslingual Generalization through Multitask Finetuning☆535Updated 8 months ago
- A Multi-Turn Dialogue Corpus based on Alpaca Instructions☆171Updated 2 years ago
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆227Updated last year
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Updated 2 years ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Updated last year
- Unofficial implementation of AlpaGasus☆91Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆276Updated 4 months ago
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆126Updated last year
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆178Updated last year
- Official repository for LongChat and LongEval☆518Updated last year
- ☆76Updated last year
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆124Updated 8 months ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 4 months ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆81Updated last year
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆305Updated 8 months ago
- [NAACL'25] TEaR framework for paper "TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement"☆46Updated 11 months ago