Alternatives and similar repositories for big_dataloader

Users that are interested in big_dataloader are comparing it to the libraries listed below

• Lisennlp / distributed_train_pytorch
  pytorch分布式训练，支持多机多卡，单机多卡。
  ☆43Updated 4 years ago
• alibaba-damo-academy / SpokenNLP
  A wide variety of research projects developed by the SpokenNLP team of Speech Lab, Alibaba Group.
  ☆123Updated 7 months ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• OctopusMind / DPO
  dpo算法实现
  ☆50Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆68Updated 3 years ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆69Updated 2 years ago
• MikeGu721 / EasyLLM
  make LLM easier to use
  ☆59Updated 2 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆154Updated 3 years ago
• WENGSYX / Low-resource-text-translation
  科大讯飞低资源多语种文本翻译挑战赛获奖方案
  ☆27Updated 2 years ago
• ShomyLiu / torch-ddp-examples
  A text classification example using ddp horovod and accelerate
  ☆33Updated 4 years ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated 2 years ago
• bojone / shuffle
  Python下shuffle几百G文件
  ☆33Updated 4 years ago
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆56Updated 3 years ago
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆191Updated 3 years ago
• xinyi-code / NLP-Loss-Pytorch
  Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al
  ☆268Updated 2 years ago
• xyjigsaw / LLM-Pretrain-SFT
  Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)
  ☆87Updated last year
• zhoucz97 / awesome-ChatGPT
  ChatGPT相关资源汇总
  ☆56Updated 2 years ago
• bitallin / MiduCTC-competition
  文本智能校对大赛(Chinese Text Correction)的baseline
  ☆67Updated 3 years ago
• liushulinle / CRASpell
  The code for our ACL2022 findings paper: CRACSpell: A Contextual Typo Robust Approach with Copy Mechanism to Improve Chinese Spelling Cor…
  ☆76Updated 3 years ago
• 5663015 / LLMs_train
  一套代码指令微调大模型
  ☆38Updated 2 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 4 years ago
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆91Updated 3 years ago
• Tencent / Lichee
  一个多模态内容理解算法框架，其中包含数据处理、预训练模型、常见模型以及模型加速等模块。
  ☆323Updated 4 years ago
• Christmas-Wong / paper_project
  论文模型复现
  ☆43Updated 3 years ago
• THUKElab / CCL2023-CLTC-THU_KELab
  This repository open-sources our GEC system submitted by THU KELab (sz) in the CCL2023-CLTC Track 1: Multidimensional Chinese Learner Tex…
  ☆15Updated 2 years ago
• wxl1999 / PLMPapers
  A paper list of pre-trained language models (PLMs).
  ☆81Updated 4 years ago
• lc222 / BELLE-LORA
  LORA微调BLOOMZ，参考BELLE
  ☆25Updated 2 years ago
• CLUEbenchmark / SuperCLUE-Math6
  SuperCLUE-Math6：新一代中文原生多轮多步数学推理数据集的探索之旅
  ☆60Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆154Updated 2 years ago