LydiaXiaohongLi/Megatron-DeepSpeed external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

LydiaXiaohongLi/Megatron-DeepSpeed

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/LydiaXiaohongLi/Megatron-DeepSpeed)

Close

LydiaXiaohongLi / Megatron-DeepSpeedView on GitHubMore

• External links
• Readme badge

Ongoing research training transformer language models at scale, including: BERT & GPT-2

☆19Jul 20, 2023Updated 2 years ago

Alternatives and similar repositories for Megatron-DeepSpeed

Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• genggui001 / Megatron-DeepSpeed-Llama

  View on GitHub
  ☆84Sep 9, 2023Updated 2 years ago
• Xiefeng69 / Awesome-Entity-Alignment

  View on GitHub
  Awesome Entity Alignment is a collection of EA techniques, including papers, codes, and datasets.
  ☆11Oct 27, 2022Updated 3 years ago
• chenzen94 / debug-deepspeed-chat

  View on GitHub
  Debug DeepSpeed-Chat step by step in IDE (在IDE里一步一步调试DeepSpeed-Chat)
  ☆10Apr 17, 2023Updated 2 years ago
• ledmaster / unified-embeddings

  View on GitHub
  Implementation of Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems
  ☆14Nov 11, 2023Updated 2 years ago
• nikhilsab / LLMFE

  View on GitHub
  This is the official repo for the paper "LLM-FE"
  ☆64Mar 5, 2026Updated 3 weeks ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis

  View on GitHub
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Jul 6, 2023Updated 2 years ago
• NicholasCao / Awesome-Chinese-ChatGPT

  View on GitHub
  收录实现中文版ChatGPT的各种技术路线，数据及其他资料
  ☆35Jul 12, 2023Updated 2 years ago
• wzhang1 / iNaturalist

  View on GitHub
  MXNet finetune baseline (res152) for challenger.ai/competition/scene
  ☆11Sep 24, 2017Updated 8 years ago
• loveisp / KDD_2024_AQA

  View on GitHub
  KDD 2024 AQA competition 2nd place solution
  ☆12Jul 21, 2024Updated last year
• xiangking / prompt_uie_torch

  View on GitHub
  基于PaddleNLP开源的抽取式UIE进行医学命名实体识别（torch实现）
  ☆44Aug 5, 2022Updated 3 years ago
• nataliagullon / segmentation-retinal-lesions

  View on GitHub
  Retinal lesions segmentation using CNNs and adversarial training: A Degree Thesis Submitted to the Faculty of Escola Tècnica d’Enginyeria…
  ☆10Oct 27, 2019Updated 6 years ago
• GioGioBond / NBCEonChatGLM6b

  View on GitHub
  (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b
  ☆15Jun 7, 2023Updated 2 years ago
• jiangjiechen / EDUCAT

  View on GitHub
  Resources for our AAAI 2022 paper: "Unsupervised Editing for Counterfactual Stories".
  ☆11Oct 25, 2022Updated 3 years ago
• enze5088 / ChineseliteratureDataset

  View on GitHub
  中华经典文献数据集
  ☆20Jun 29, 2023Updated 2 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• lrs1353281004 / ChatGPT_recipes

  View on GitHub
  持续追踪ChatGPT相关的技术资料和行业进展。
  ☆11Apr 24, 2023Updated 2 years ago
• keezen / ntk_alibi

  View on GitHub
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆69Aug 16, 2023Updated 2 years ago
• MaitySubhajit / SelfDocSeg

  View on GitHub
  [ICDAR 2023] SelfDocSeg: A self-supervised vision-based approach towards Document Segmentation (Oral)
  ☆42Oct 6, 2023Updated 2 years ago
• yanqiangmiffy / how-to-train-tokenizer

  View on GitHub
  怎么训练一个LLM分词器
  ☆152Jul 13, 2023Updated 2 years ago
• PhantomGrapes / MGeoExample

  View on GitHub
  Examples about using MGeo finetune models
  ☆55Feb 9, 2023Updated 3 years ago
• DA-southampton / DaguanFengxian

  View on GitHub
  DataFountain第五届达观杯第4名方案
  ☆11Dec 3, 2021Updated 4 years ago
• spc2 / useLevenbergMarquardt

  View on GitHub
  The Levenberg-Marquardt method solves nonlinear least square problem
  ☆12Dec 3, 2019Updated 6 years ago
• lifu-tu / Study-NLP-Robustness

  View on GitHub
  Code for TACL 2020 paper "An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models"
  ☆14Jul 31, 2020Updated 5 years ago
• laihuiyuan / mFLAG

  View on GitHub
  Multi-Figurative Language Generation (COLING 2022)
  ☆12Jan 30, 2023Updated 3 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• lmc2179 / von_mises_fisher

  View on GitHub
  Model your data with the Von Mises-Fisher distribution in Python
  ☆13Feb 1, 2016Updated 10 years ago
• gist-ailab / deep-grasping

  View on GitHub
  ROS wrapper for DNN based robotic grasping algorithms
  ☆21Nov 5, 2022Updated 3 years ago
• Lauorie / DFT

  View on GitHub
  Reproduced the DFT method without using Verl. https://arxiv.org/abs/2508.05629
  ☆21Oct 14, 2025Updated 5 months ago
• gengchenmai / sphere2vec

  View on GitHub
  ☆26Jul 13, 2023Updated 2 years ago
• ml-researcher / VAE

  View on GitHub
  ☆11Oct 8, 2022Updated 3 years ago
• yeyedas / datadown-tiantianfund

  View on GitHub
  通过天天基金网数据接口下载/更新基金数据
  ☆11Jan 18, 2022Updated 4 years ago
• nwnlp / cnn-asr

  View on GitHub
  a simple asr system
  ☆14Mar 8, 2018Updated 8 years ago
• verlab / SceneUnderstanding_CIARP_2017

  View on GitHub
  ☆12Apr 23, 2018Updated 7 years ago
• mzbac / qlora-inference-multi-gpu

  View on GitHub
  ☆13May 25, 2023Updated 2 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• momo-journey / CDial-GPT-NEZHA

  View on GitHub
  pytorch版基于gpt+nezha的中文多轮Cdial
  ☆11Oct 22, 2022Updated 3 years ago
• taishan1994 / classical_chinese_extraction

  View on GitHub
  文言文信息抽取（实体识别+关系抽取）
  ☆10Feb 24, 2023Updated 3 years ago
• sandeepsoni / MHP

  View on GitHub
  Generation and MLE Estimation for Multivariate Hawkes Process
  ☆11Oct 3, 2019Updated 6 years ago
• OpenLLMAI / OpenLLMDE

  View on GitHub
  OpenLLMDE: An open source data engineering framework for LLMs
  ☆18Sep 9, 2023Updated 2 years ago
• lucas-acc / HMM_POS

  View on GitHub
  a simple implementation of part-of-speech tagging with hmm
  ☆13Feb 26, 2019Updated 7 years ago
• swtheing / LLM-Performance-Improvement-Paper

  View on GitHub
  ☆17Jul 10, 2023Updated 2 years ago
• korilin / vuepress-theme-twipress

  View on GitHub
  A VuePress theme modeled after parts of Twitter interface design
  ☆14Jul 22, 2021Updated 4 years ago