hpcaitech / ColossalAI-Pytorch-lightningLinks
β24Updated 2 years ago
Alternatives and similar repositories for ColossalAI-Pytorch-lightning
Users that are interested in ColossalAI-Pytorch-lightning are comparing it to the libraries listed below
Sorting:
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AIβ56Updated last year
- π€ Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.β82Updated 3 years ago
- DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization (ACL 2022)β50Updated 2 years ago
- Transformers at any scaleβ41Updated last year
- β38Updated last year
- β21Updated 3 years ago
- Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorchβ46Updated 4 years ago
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generationβ119Updated 2 years ago
- A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semantiβ¦β21Updated 3 years ago
- This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.β48Updated 3 years ago
- Source code for paper: Knowledge Inheritance for Pre-trained Language Modelsβ38Updated 3 years ago
- β12Updated last year
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Proβ¦β62Updated 3 months ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)β102Updated 4 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogueβ32Updated 2 years ago
- β99Updated 3 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".β65Updated 4 years ago
- Calculating Expected Time for training LLM.β38Updated 2 years ago
- β97Updated 2 years ago
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"β47Updated 3 years ago
- PyTorch reimplementation of REALM and ORQAβ22Updated 3 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"β58Updated 2 years ago
- Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.β32Updated 3 years ago
- Long-context pretrained encoder-decoder modelsβ96Updated 2 years ago
- FairSeq repo with Apollo optimizerβ114Updated last year
- Code for EMNLP 2021 paper: Improving Sequence-to-Sequence Pre-training via Sequence Span Rewritingβ17Updated 3 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-trainingβ18Updated 10 months ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorchβ76Updated 2 years ago
- Code for "Mixed Cross Entropy Loss for Neural Machine Translation"β20Updated 4 years ago
- Pre-training BART in Flax on The Pile datasetβ22Updated 4 years ago