Alternatives and similar repositories for Transformer_Knowlegde

Users that are interested in Transformer_Knowlegde are comparing it to the libraries listed below

• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆154Updated 7 months ago
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆367Updated last year
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated 2 years ago
• OctopusMind / DPO
  dpo算法实现
  ☆38Updated 11 months ago
• Mryangkaitong / deepseek-r1-gsm8k
  ☆42Updated 3 months ago
• WangHuiNEU / llm
  The Roadmap for LLMs
  ☆84Updated last year
• infly-ai / INF-LLM
  The official repo of INF-34B models trained by INF Technology.
  ☆35Updated 9 months ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆68Updated last year
• Outsider565 / LoRA-GA
  ☆194Updated 6 months ago
• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆276Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆67Updated 3 years ago
• cauyxy / bilivideos
  ☆52Updated last year
• JunnYu / RoFormer_pytorch
  RoFormer V1 & V2 pytorch
  ☆498Updated 3 years ago
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆65Updated last year
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆62Updated 3 months ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆61Updated 2 years ago
• 1140310118 / tdlm
  实现了Transformer中的几种位置编码方案
  ☆43Updated 3 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆103Updated 2 years ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆190Updated 2 months ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆122Updated last year
• dongguanting / In-Context-Learning_PaperList
  Paper List for In-context Learning 🌷
  ☆183Updated last year
• wxl1999 / PLMPapers
  A paper list of pre-trained language models (PLMs).
  ☆80Updated 3 years ago
• ShomyLiu / torch-ddp-examples
  A text classification example using ddp horovod and accelerate
  ☆33Updated 3 years ago
• transformer-vq / transformer_vq
  ☆191Updated last year
• bytedance / LargeBatchCTR
  Large batch training of CTR models based on DeepCTR with CowClip.
  ☆168Updated 2 years ago
• thuml / LogME
  Code release for "LogME: Practical Assessment of Pre-trained Models for Transfer Learning" (ICML 2021) and Ranking and Tuning Pre-trained…
  ☆209Updated last year
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆97Updated 9 months ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆152Updated 2 years ago