Alternatives and similar repositories for Cybertron:

Users that are interested in Cybertron are comparing it to the libraries listed below

• lvyufeng / mindspore-nlp-tutorial
  Natural Language Processing Tutorial for MindSpore Users
  ☆142Updated 11 months ago
• lvyufeng / easy_mindspore_bk
  ☆18Updated 2 years ago
• lvyufeng / MindSpore-GAN
  MindSpore implementations of Generative Adversarial Networks.
  ☆22Updated 2 years ago
• mindspore-courses / d2l-mindspore
  《动手学深度学习》的MindSpore实现。供MindSpore学习者配合李沐老师课程使用。
  ☆115Updated last year
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆64Updated last year
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated 2 years ago
• NiuTrans / Introduction-to-Transformers
  An introduction to basic concepts of Transformers and key techniques of their recent advances.
  ☆49Updated last year
• mindspore-lab / mindformers
  ☆158Updated this week
• mdy666 / mdy_triton
  ☆108Updated this week
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated 2 years ago
• cauyxy / bilivideos
  ☆52Updated last year
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆158Updated last year
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆103Updated 2 years ago
• IndexFziQ / Diffusion4NLP-Papers
  A paper list about diffusion models for natural language processing.
  ☆182Updated last year
• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆51Updated 3 years ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆60Updated 2 years ago
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆152Updated 5 months ago
• Outsider565 / LoRA-GA
  ☆185Updated 5 months ago
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆109Updated 10 months ago
• JunnYu / RoFormer_pytorch
  RoFormer V1 & V2 pytorch
  ☆491Updated 2 years ago
• haoxizhong / pytorch-worker
  A framework for training, evaluating and testing models in pytorch.
  ☆82Updated 2 years ago
• lrs1353281004 / seq2seq_transformers_text_generation
  seq_2_seq text generation based on transformers
  ☆24Updated 4 years ago
• bojone / LST-CLUE
  Ladder Side-Tuning在CLUE上的简单尝试
  ☆19Updated 2 years ago
• nlp-greyfoss / metagrad
  一个用于学习的仿Pytorch纯Python实现的自动求导工具。
  ☆51Updated 11 months ago
• sisrfeng / n_gpu
  📊 A simple command-line utility for querying and monitoring GPU status
  ☆90Updated 2 years ago
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆96Updated 2 years ago
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆45Updated last year
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆95Updated last year
• sunkx109 / llama
  Inference code for LLaMA models
  ☆118Updated last year