Alternatives and similar repositories for Cybertron:

Users that are interested in Cybertron are comparing it to the libraries listed below

• lvyufeng / mindspore-nlp-tutorial
  Natural Language Processing Tutorial for MindSpore Users
  ☆142Updated 10 months ago
• mindspore-courses / d2l-mindspore
  《动手学深度学习》的MindSpore实现。供MindSpore学习者配合李沐老师课程使用。
  ☆113Updated last year
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆151Updated 4 months ago
• lvyufeng / MindSpore-GAN
  MindSpore implementations of Generative Adversarial Networks.
  ☆22Updated 2 years ago
• mdy666 / mdy_triton
  ☆62Updated last week
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆45Updated last year
• chunhuizhang / bert_t5_gpt
  ☆62Updated last month
• lvyufeng / easy_mindspore_bk
  ☆18Updated 2 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated last year
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆63Updated last year
• Ascend / AscendSpeed
  ☆76Updated last year
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆398Updated last month
• sunkx109 / llama
  Inference code for LLaMA models
  ☆113Updated last year
• Qihoo360 / 360-LLaMA-Factory
  adds Sequence Parallelism into LLaMA-Factory
  ☆154Updated this week
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆49Updated last month
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆35Updated 6 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆61Updated last year
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: parallel speculative decoding with adaptive draft length
  ☆39Updated this week
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆51Updated 3 years ago
• cauyxy / bilivideos
  ☆52Updated last year
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆281Updated last year
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆96Updated 4 months ago
• luxuantao / advanced_LLM_interview_notes
  大模型进阶面经
  ☆26Updated last week
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆107Updated last year
• Outsider565 / LoRA-GA
  ☆177Updated 4 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆92Updated last year
• IndexFziQ / Diffusion4NLP-Papers
  A paper list about diffusion models for natural language processing.
  ☆181Updated last year