Alternatives and similar repositories for cybertron-ai

Users that are interested in cybertron-ai are comparing it to the libraries listed below

• lvyufeng / mindspore-nlp-tutorial
  Natural Language Processing Tutorial for MindSpore Users
  ☆140Updated last year
• lvyufeng / MindSpore-GAN
  MindSpore implementations of Generative Adversarial Networks.
  ☆23Updated 3 years ago
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆165Updated 2 years ago
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆47Updated 2 years ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆193Updated 3 years ago
• Ascend / AscendSpeed
  ☆79Updated last year
• mindspore-lab / d2l-mindspore
  《动手学深度学习》的MindSpore实现。供MindSpore学习者配合李沐老师课程使用。
  ☆123Updated 2 years ago
• mdy666 / mdy_triton
  ☆150Updated 5 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆95Updated 3 weeks ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆406Updated 4 months ago
• lvyufeng / easy_mindspore_bk
  ☆18Updated 3 years ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆128Updated 2 years ago
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆263Updated 2 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆100Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆70Updated 2 years ago
• sxontheway / Keep-Learning
  The record of what I‘ve been through. Now moved to Notion. See link below
  ☆101Updated 10 months ago
• ZRayZzz / flash-attention-v100
  ☆63Updated last year
• cauyxy / bilivideos
  ☆51Updated 2 years ago
• firechecking / CleanParallel
  an implementation of parallel skills like amp, ddp, pp, tp for learning purposes
  ☆14Updated 2 years ago
• nlp-greyfoss / metagrad
  一个用于学习的仿Pytorch纯Python实现的自动求导工具。
  ☆51Updated last year
• mindspore-lab / mindrlhf
  ☆36Updated 11 months ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆159Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆417Updated last year
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated 2 years ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆183Updated 2 years ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆84Updated last month
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆213Updated 10 months ago
• fkodom / grouped-query-attention-pytorch
  (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …
  ☆185Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆176Updated 11 months ago