Alternatives and similar repositories for BigTranslate

Users that are interested in BigTranslate are comparing it to the libraries listed below

• wxjiao / ParroT
  The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…
  ☆174Updated 5 months ago
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆529Updated last month
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆185Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆104Updated 6 months ago
• hsing-wang / Awesome-LLM-MT
  ☆243Updated last year
• pluiez / NLLB-inference
  ☆57Updated 2 years ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆209Updated last year
• Guanaco-Model / Guanaco-Model.github.io
  ☆124Updated last year
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆72Updated 2 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆101Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆122Updated 9 months ago
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆535Updated 8 months ago
• icip-cas / ChatAlpaca
  A Multi-Turn Dialogue Corpus based on Alpaca Instructions
  ☆171Updated 2 years ago
• kaistAI / SelFee
  Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"
  ☆227Updated last year
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆91Updated last year
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆276Updated 4 months ago
• shjwudp / c4-dataset-script
  Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…
  ☆126Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆518Updated last year
• DAMO-NLP-MT / PolyLM
  ☆76Updated last year
• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆124Updated 8 months ago
• gmftbyGMFTBY / Copyisallyouneed
  [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM
  ☆186Updated 4 months ago
• vihangd / alpaca-qlora
  Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA
  ☆81Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆305Updated 8 months ago
• fzp0424 / self_correct_mt
  [NAACL'25] TEaR framework for paper "TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement"
  ☆46Updated 11 months ago