Lightning-Universe/lightning-ColossalAI external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Lightning-Universe/lightning-ColossalAI

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Lightning-Universe/lightning-ColossalAI)

Close

Lightning-Universe / lightning-ColossalAIView on GitHubMore

• External links
• Readme badge

Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI

☆56Sep 1, 2023Updated 2 years ago

Alternatives and similar repositories for lightning-ColossalAI

Users that are interested in lightning-ColossalAI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• hpcaitech / ColossalAI-Pytorch-lightning

  View on GitHub
  ☆24Nov 22, 2022Updated 3 years ago
• Beomi / transformers-language-modeling

  View on GitHub
  Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
  ☆23May 20, 2021Updated 4 years ago
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 5 months ago
• jason9693 / oslo-kogpt-finetunig

  View on GitHub
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Aug 26, 2022Updated 3 years ago
• songys / 2021Langcon

  View on GitHub
  ☆11Oct 3, 2021Updated 4 years ago
• LAION-AI / Anh

  View on GitHub
  Anh - LAION's multilingual assistant datasets and models
  ☆27Apr 5, 2023Updated 2 years ago
• JoungheeKim / kor-spacing

  View on GitHub
  This is project for korean auto spacing
  ☆12Aug 3, 2020Updated 5 years ago
• korean-named-entity / konec

  View on GitHub
  Korean Named Entity Corpus
  ☆25May 12, 2023Updated 2 years ago
• ko-nlp / moducorpus-sanitizer

  View on GitHub
  모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.
  ☆11Mar 2, 2022Updated 4 years ago
• LennartKeller / roberta2longformer

  View on GitHub
  Convert pretrained RoBerta models to various long-document transformer models
  ☆11Apr 5, 2022Updated 3 years ago
• tlkh / t2t-tuner

  View on GitHub
  Convenient Text-to-Text Training for Transformers
  ☆19Dec 10, 2021Updated 4 years ago
• snoop2head / KLUE-RBERT

  View on GitHub
  ↔️ Utilizing RBERT model structure for KLUE Relation Extraction task
  ☆15Nov 15, 2022Updated 3 years ago
• detail-novelist / novelist-triton-server

  View on GitHub
  Deploy KoGPT with Triton Inference Server
  ☆14Nov 18, 2022Updated 3 years ago
• passing2961 / EmoNSMC

  View on GitHub
  Korean large emotion labeled dataset (EmoNSMC)
  ☆14Mar 5, 2020Updated 6 years ago
• jason9693 / ETA4LLMs

  View on GitHub
  Calculating Expected Time for training LLM.
  ☆38Apr 17, 2023Updated 2 years ago
• triplet02 / KoNPron

  View on GitHub
  Convert Numerical Representations to Korean Pronunciation
  ☆14Apr 20, 2020Updated 5 years ago
• snunlp / KR-ELECTRA

  View on GitHub
  KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorch
  ☆15Feb 13, 2022Updated 4 years ago
• microsoft / Efficient-Large-LM-Trainer

  View on GitHub
  ☆39Jul 25, 2024Updated last year
• Flawless1202 / Transformer

  View on GitHub
  A Pytorch-Lightning Implementation of Transformer Network
  ☆11Oct 22, 2020Updated 5 years ago
• robinsongh381 / UNILM_Pytorch_Korean

  View on GitHub
  ☆11Jul 5, 2020Updated 5 years ago
• noowad93 / chosung-translator

  View on GitHub
  초성 해석기 based on ko-BART
  ☆29Mar 31, 2021Updated 4 years ago
• doublems / korean-bad-words

  View on GitHub
  I hope to this list will contribute good influence in Korean online services.
  ☆63Feb 10, 2019Updated 7 years ago
• SKplanet / Dialog-KoELECTRA

  View on GitHub
  ELECTRA기반 한국어 대화체 언어모델
  ☆53Aug 4, 2021Updated 4 years ago
• korean-named-entity / konne

  View on GitHub
  Korean Nested Named Entity Corpus
  ☆20May 13, 2023Updated 2 years ago
• sohyeon98720 / KoGPT2-finetuning

  View on GitHub
  한국어 자연어 처리 모델 미세조정
  ☆17Jan 26, 2021Updated 5 years ago
• seujung / kolang-t5-base

  View on GitHub
  T5-base model for Korean
  ☆27May 20, 2021Updated 4 years ago
• L0Z1K / para-Kor

  View on GitHub
  Create paraphrasing korean sentence with GPT-3
  ☆34Jan 30, 2023Updated 3 years ago
• kakaoenterprise / KorAdvMRSTestData

  View on GitHub
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Dec 16, 2021Updated 4 years ago
• jason9693 / polyglot-finetuning-oslo

  View on GitHub
  ☆19Sep 20, 2022Updated 3 years ago
• hyunwoongko / megatron-11b

  View on GitHub
  Megatron LM 11B on Huggingface Transformers
  ☆27Jul 11, 2021Updated 4 years ago
• jiacheng-xu / sum-interpret

  View on GitHub
  Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)
  ☆13Jun 2, 2021Updated 4 years ago
• DeepSE / gpt_playground

  View on GitHub
  ☆37Nov 20, 2021Updated 4 years ago
• hpcaitech / Elixir

  View on GitHub
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆15Jun 8, 2023Updated 2 years ago
• formidable-stella / ShareGPT-translation

  View on GitHub
  ☆21May 24, 2023Updated 2 years ago
• 2runo / dl_numpy

  View on GitHub
  NumPy로 구현한 딥러닝 라이브러리입니다. (자동 미분 지원)
  ☆15May 4, 2021Updated 4 years ago
• QuoQA-NLP / T5_Translation

  View on GitHub
  ↔️ T5 Machine Translation from English to Korean
  ☆18Aug 11, 2022Updated 3 years ago
• monologg / kakaotrans

  View on GitHub
  [Unofficial] Kakaotrans: Kakao translate API for python
  ☆16Mar 29, 2020Updated 5 years ago
• Beomi / easy-lm-trainer

  View on GitHub
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆59May 23, 2023Updated 2 years ago
• JoJo0217 / rlhf_korean_dataset

  View on GitHub
  For the rlhf learning environment of Koreans
  ☆25Sep 25, 2023Updated 2 years ago