Alternatives and similar repositories for ColossalAI-Examples:

Users that are interested in ColossalAI-Examples are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 2 years ago
• hpcaitech / EnergonAI
  Large-scale model inference.
  ☆629Updated last year
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆584Updated this week
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆402Updated this week
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆581Updated 2 years ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆152Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,386Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 7 months ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆561Updated 6 months ago
• TsinghuaAI / CPM
  Introduction to CPM
  ☆165Updated 3 years ago
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆471Updated last year
• XueFuzhao / InstructionWild
  ☆459Updated 10 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆218Updated last year
• volcengine / veGiantModel
  ☆214Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆806Updated last year
• juncongmoo / minichatgpt
  minichatgpt - To Train ChatGPT In 5 Minutes
  ☆167Updated last year
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆111Updated 2 years ago
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆160Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆309Updated 2 years ago
• hpcaitech / SkyComputing
  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
  ☆90Updated 2 years ago
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆213Updated 11 months ago
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆531Updated 7 months ago
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆820Updated 2 years ago
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆519Updated 11 months ago
• Tencent / PatrickStar
  PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
  ☆758Updated 2 years ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆104Updated 2 years ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆442Updated 6 months ago
• BlinkDL / RWKV-CUDA
  The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
  ☆222Updated 4 months ago
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆992Updated 8 months ago