ZhuiyiTechnology / GAU-alpha

Related projects ⓘ

Alternatives and complementary repositories for GAU-alpha

• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆67Updated 2 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆150Updated 2 years ago
• 1140310118 / tdlm
  实现了Transformer中的几种位置编码方案
  ☆36Updated 3 years ago
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆90Updated 2 years ago
• wxl1999 / PLMPapers
  A paper list of pre-trained language models (PLMs).
  ☆79Updated 2 years ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated last year
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆101Updated 2 years ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆66Updated last year
• bojone / LST-CLUE
  Ladder Side-Tuning在CLUE上的简单尝试
  ☆19Updated 2 years ago
• TsinghuaAI / CUGE
  ☆53Updated 2 years ago
• Hzfinfdu / PLMTuningCompetition
  擂台赛3-大规模预训练调优比赛的示例代码与baseline实现
  ☆38Updated 2 years ago
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated last year
• bojone / CLUE-bert4keras
  真 · “Deep Learning for Humans”
  ☆140Updated 2 years ago
• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆51Updated 3 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆114Updated 8 months ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆252Updated 4 years ago
• TsinghuaAI / CPM-2-Finetune
  Finetune CPM-2
  ☆83Updated last year
• LowinLi / chinese-bigbird
  中文bigbird预训练模型
  ☆89Updated 2 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆191Updated last year
• bojone / P-tuning
  P-tuning方法在中文上的简单实验
  ☆138Updated 3 years ago
• JunnYu / RoFormer_pytorch
  RoFormer V1 & V2 pytorch
  ☆473Updated 2 years ago
• xsysigma / TencentLLMEval
  TencentLLMEval is a comprehensive and extensive benchmark for artificial evaluation of large models that includes task trees, standards, …
  ☆38Updated 2 months ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆56Updated last year
• PaddlePaddle / TrustAI
  飞桨可信AI
  ☆184Updated last year
• zhoucz97 / awesome-ChatGPT
  ChatGPT相关资源汇总
  ☆53Updated last year
• LydiaXiaohongLi / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Updated last year
• zhouj8553 / FlipDA
  ☆65Updated 5 months ago
• zenRRan / AI-Algorithm-Job-Summary
  记录NLP、CV、搜索、推荐等AI岗位最新情况。
  ☆28Updated last year
• lonePatient / TorchBlocks
  A PyTorch-based toolkit for natural language processing
  ☆153Updated last year
• JunnYu / WoBERT_pytorch
  WoBERT_pytorch
  ☆40Updated 3 years ago