Alternatives and similar repositories for deepspeed-gpt-neox:

Users that are interested in deepspeed-gpt-neox are comparing it to the libraries listed below

• hyunwoongko / megatron-11b
  Megatron LM 11B on Huggingface Transformers
  ☆27Updated 3 years ago
• EleutherAI / polyglot-data
  data related codebase for polyglot project
  ☆19Updated last year
• hpcaitech / ColossalAI-Pytorch-lightning
  ☆24Updated 2 years ago
• LAION-AI / Anh
  Anh - LAION's multilingual assistant datasets and models
  ☆27Updated last year
• tlkh / t2t-tuner
  Convenient Text-to-Text Training for Transformers
  ☆19Updated 3 years ago
• QuoQA-NLP / T5_Translation
  ↔️ T5 Machine Translation from English to Korean
  ☆17Updated 2 years ago
• nawnoes / pytorch-gpt-x
  Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
  ☆32Updated 3 years ago
• microsoft / SmartWordSuggestions
  Repo for "Smart Word Suggestions" (SWS) task and benchmark
  ☆20Updated last year
• pytorch-tpu / transformers
  🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
  ☆14Updated this week
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆58Updated last year
• hyunwoongko / stop-sequencer
  Implementation of stop sequencer for Huggingface Transformers
  ☆16Updated last year
• Beomi / transformers-language-modeling
  Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
  ☆23Updated 3 years ago
• jason9693 / polyglot-finetuning-oslo
  ☆19Updated 2 years ago
• openkorpos / model-mecab
  MeCab model trained with OpenKorPos.
  ☆22Updated 2 years ago
• hyunwoongko / beyond-lm
  Beyond LM: How can language model go forward in the future?
  ☆15Updated last year
• MrBananaHuman / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆19Updated last year
• dlfrnaos19 / tpu-starter-korean
  ☆10Updated 2 years ago
• ModuNLP / weekly-meeting
  매주 목요일, 20:00 모임
  ☆16Updated 4 years ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆192Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆13Updated last year
• detail-novelist / novelist-triton-server
  Deploy KoGPT with Triton Inference Server
  ☆14Updated 2 years ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• jason9693 / ETA4LLMs
  Calculating Expected Time for training LLM.
  ☆38Updated last year
• leogao2 / lm_dataformat
  ☆77Updated last year