Alternatives and similar repositories for ColossalAI-Pytorch-lightning

Users that are interested in ColossalAI-Pytorch-lightning are comparing it to the libraries listed below

• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated 2 years ago
• cimeister / typical-sampling
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆81Updated 3 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆46Updated 4 years ago
• yxuansu / Contrastive_Search_Is_What_You_Need
  [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation
  ☆121Updated 2 years ago
• facebookresearch / ELECTRA-Fewshot-Learning
  This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.
  ☆48Updated 3 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆42Updated last year
• microsoft / Efficient-Large-LM-Trainer
  ☆39Updated last year
• amazon-science / dq-bart
  DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization (ACL 2022)
  ☆50Updated 2 years ago
• jason9693 / ETA4LLMs
  Calculating Expected Time for training LLM.
  ☆38Updated 2 years ago
• lyutyuh / structured-span-selector
  A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…
  ☆21Updated 3 years ago
• qqaatw / pytorch-realm-orqa
  PyTorch reimplementation of REALM and ORQA
  ☆22Updated 3 years ago
• facebookresearch / bart_ls
  Long-context pretrained encoder-decoder models
  ☆96Updated 3 years ago
• thunlp / TR-BERT
  Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"
  ☆48Updated 3 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆113Updated 2 years ago
• thunlp / Knowledge-Inheritance
  Source code for paper: Knowledge Inheritance for Pre-trained Language Models
  ☆38Updated 3 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 3 years ago
• MichaelZhouwang / Sequence_Span_Rewriting
  Code for EMNLP 2021 paper: Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting
  ☆17Updated 4 years ago
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆28Updated 2 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• amazon-science / transformers-data-augmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆52Updated 2 years ago
• yeonsw / RankEncoder
  ☆35Updated 2 years ago
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆48Updated 3 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 4 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆102Updated 5 years ago
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated last year
• princeton-nlp / DinkyTrain
  Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃
  ☆114Updated 3 years ago
• NAR-tutorial / acl2022
  ☆99Updated 3 years ago
• rsvp-ai / segatron_aaai
  codes and pre-trained models of paper "Segatron: Segment-aware Transformer for Language Modeling and Understanding"
  ☆18Updated 3 years ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated 2 years ago
• facebookresearch / ketod
  KETOD Knowledge-Enriched Task-Oriented Dialogue
  ☆32Updated 2 years ago