Alternatives and similar repositories for Cybertron:

Users that are interested in Cybertron are comparing it to the libraries listed below

• lvyufeng / mindspore-nlp-tutorial
  Natural Language Processing Tutorial for MindSpore Users
  ☆142Updated 9 months ago
• mindspore-courses / d2l-mindspore
  《动手学深度学习》的MindSpore实现。供MindSpore学习者配合李沐老师课程使用。
  ☆113Updated last year
• lvyufeng / easy_mindspore_bk
  ☆18Updated 2 years ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆60Updated last year
• mdy666 / mdy_triton
  ☆33Updated this week
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆149Updated 3 months ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆57Updated 7 months ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆96Updated 3 months ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆106Updated last year
• smart-lty / ParallelSpeculativeDecoding
  The official code for paper "parallel speculative decoding with adaptive draft length."
  ☆32Updated 4 months ago
• lvyufeng / MindSpore-GAN
  MindSpore implementations of Generative Adversarial Networks.
  ☆22Updated 2 years ago
• Ascend / AscendSpeed
  ☆76Updated last year
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆44Updated last year
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆97Updated 8 months ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆146Updated last year
• cauyxy / bilivideos
  ☆52Updated last year
• madsys-dev / deepseekv2-profile
  ☆71Updated 5 months ago
• chunhuizhang / bert_t5_gpt
  ☆61Updated last week
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆47Updated 5 months ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆114Updated last year
• mindspore-lab / mindrlhf
  ☆29Updated last month
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆152Updated last year
• ShomyLiu / torch-ddp-examples
  A text classification example using ddp horovod and accelerate
  ☆33Updated 3 years ago
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆62Updated last year
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆90Updated 2 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated last year
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆102Updated 2 years ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆169Updated 2 years ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆87Updated 10 months ago
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆110Updated 2 years ago