lvyufeng / Cybertron

Related projects: ⓘ

• lvyufeng / mindspore-nlp-tutorial
  Natural Language Processing Tutorial for MindSpore Users
  ☆139Updated 5 months ago
• lvyufeng / easy_mindspore
  ☆18Updated last year
• mindspore-courses / d2l-mindspore
  《动手学深度学习》的MindSpore实现。供MindSpore学习者配合李沐老师课程使用。
  ☆102Updated last year
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆72Updated 3 weeks ago
• lvyufeng / MindSpore-GAN
  MindSpore implementations of Generative Adversarial Networks.
  ☆21Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆139Updated 10 months ago
• cauyxy / bilivideos
  ☆49Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆95Updated last year
• Outsider565 / LoRA-GA
  ☆125Updated last week
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆95Updated last year
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆100Updated last year
• yuanzhoulvpi2017 / vscode_debug_transformers
  ☆170Updated 5 months ago
• nlp-greyfoss / metagrad
  一个用于学习的仿Pytorch纯Python实现的自动求导工具。
  ☆45Updated 4 months ago
• chunhuizhang / bert_t5_gpt
  ☆48Updated 3 weeks ago
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆57Updated last year
• IndexFziQ / Diffusion4NLP-Papers
  A paper list about diffusion models for natural language processing.
  ☆170Updated last year
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆182Updated 4 months ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆51Updated 3 months ago
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆233Updated 9 months ago
• sunkx109 / My-Torch-Extension
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆25Updated 5 months ago
• keli-wen / AGI-Study
  The blog, read report and code example for AGI/LLM related knowledge.
  ☆11Updated last month
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆56Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆82Updated last year
• godweiyang / GrabGPU
  Grab GPU whenever available
  ☆272Updated 2 years ago
• mindspore-lab / mindformers
  ☆131Updated last week
• sunkx109 / llama
  Inference code for LLaMA models
  ☆101Updated last year
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆274Updated last year
• Hzfinfdu / PLMTuningCompetition
  擂台赛3-大规模预训练调优比赛的示例代码与baseline实现
  ☆38Updated last year
• fkodom / grouped-query-attention-pytorch
  (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …
  ☆116Updated 4 months ago
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆191Updated 4 months ago