Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
β55Oct 5, 2026Updated last week
Alternatives and similar repositories for lightning-ColossalAI
Users that are interested in lightning-ColossalAI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β24Nov 22, 2022Updated 3 years ago
- Train π€transformers with DeepSpeed: ZeRO-2, ZeRO-3β23May 20, 2021Updated 5 years ago
- A utility for storing and reading files for Korean LM training πΎβ35Jul 18, 2026Updated 2 months ago
- β11Oct 3, 2021Updated 5 years ago
- kogptλ₯Ό osloλ‘ νμΈνλνλ μμ .β23Aug 26, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean β’ AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Anh - LAION's multilingual assistant datasets and modelsβ28Apr 5, 2023Updated 3 years ago
- This is project for korean auto spacingβ12Aug 3, 2020Updated 6 years ago
- Korean Named Entity Corpusβ26May 12, 2023Updated 3 years ago
- Convert pretrained RoBerta models to various long-document transformer modelsβ11Apr 5, 2022Updated 4 years ago
- λͺ¨λμ λ§λμΉ λ°μ΄ν°λ₯Ό λΆμμ νΈλ¦¬ν ννλ‘ λ³ννλ κΈ°λ₯μ μ 곡ν©λλ€.β11Mar 2, 2022Updated 4 years ago
- Convenient Text-to-Text Training for Transformersβ18Dec 10, 2021Updated 4 years ago
- βοΈ Utilizing RBERT model structure for KLUE Relation Extraction taskβ15Nov 15, 2022Updated 3 years ago
- Deploy KoGPT with Triton Inference Serverβ14Nov 18, 2022Updated 3 years ago
- Korean large emotion labeled dataset (EmoNSMC)β14Mar 5, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Convert Numerical Representations to Korean Pronunciationβ14Apr 20, 2020Updated 6 years ago
- Calculating Expected Time for training LLM.β39Apr 17, 2023Updated 3 years ago
- KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorchβ15Feb 13, 2022Updated 4 years ago
- β11Jul 5, 2020Updated 6 years ago
- μ΄μ± ν΄μκΈ° based on ko-BARTβ29Mar 31, 2021Updated 5 years ago
- A Pytorch-Lightning Implementation of Transformer Networkβ11Oct 22, 2020Updated 5 years ago
- β39Jul 25, 2024Updated 2 years ago
- I hope to this list will contribute good influence in Korean online services.β62Feb 10, 2019Updated 7 years ago
- β23Jun 30, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- T5-base model for Koreanβ27May 20, 2021Updated 5 years ago
- Create paraphrasing korean sentence with GPT-3β35Jan 30, 2023Updated 3 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selectionβ34Dec 16, 2021Updated 4 years ago
- β19Sep 20, 2022Updated 4 years ago
- Korean Nested Named Entity Corpusβ21May 13, 2023Updated 3 years ago
- νκ΅μ΄ μμ°μ΄ μ²λ¦¬ λͺ¨λΈ λ―ΈμΈμ‘°μ β17Jan 26, 2021Updated 5 years ago
- β37Nov 20, 2021Updated 4 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)β13Jun 2, 2021Updated 5 years ago
- Megatron LM 11B on Huggingface Transformersβ29Jul 11, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Elixir: Train a Large Language Model on a Small GPU Clusterβ15Jun 8, 2023Updated 3 years ago
- β21May 24, 2023Updated 3 years ago
- NumPyλ‘ κ΅¬νν λ₯λ¬λ λΌμ΄λΈλ¬λ¦¬μ λλ€. (μλ λ―ΈλΆ μ§μ)β15May 4, 2021Updated 5 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)β25Apr 11, 2022Updated 4 years ago
- βοΈ T5 Machine Translation from English to Koreanβ18Aug 11, 2022Updated 4 years ago
- π€ μ΅μνμ μΈν μΌλ‘ LMμ νμ΅νκΈ° μν μνμ½λβ59May 23, 2023Updated 3 years ago
- bpe based korean t5 model for text-to-text unified frameworkβ63Apr 17, 2024Updated 2 years ago