Alternatives and similar repositories for ColossalAI-Examples

Users that are interested in ColossalAI-Examples are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆189Updated 2 years ago
• hpcaitech / EnergonAI
  Large-scale model inference.
  ☆630Updated last year
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆406Updated 2 weeks ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆564Updated 7 months ago
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆584Updated 2 years ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆152Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,391Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆594Updated last week
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆97Updated 7 months ago
• hpcaitech / SkyComputing
  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
  ☆91Updated 2 years ago
• XueFuzhao / InstructionWild
  ☆459Updated 11 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆220Updated last year
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• bytedance / ParaGen
  ParaGen is a PyTorch deep learning framework for parallel sequence generation.
  ☆186Updated 2 years ago
• BlinkDL / RWKV-CUDA
  The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
  ☆220Updated 5 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆656Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 9 months ago
• bigcode-project / Megatron-LM
  Ongoing research training transformer models at scale
  ☆387Updated 9 months ago
• henrywoo / minichatgpt
  minichatgpt - To Train ChatGPT In 5 Minutes
  ☆168Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆518Updated last year
• Vahe1994 / SpQR
  ☆543Updated 5 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆95Updated last year
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆113Updated 2 years ago
• triton-inference-server / fastertransformer_backend
  ☆411Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆300Updated 2 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆313Updated 2 years ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆469Updated last year