Alternatives and similar repositories for ColossalAI-Examples:

Users that are interested in ColossalAI-Examples are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆191Updated 2 years ago
• hpcaitech / EnergonAI
  Large-scale model inference.
  ☆628Updated last year
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆562Updated 5 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆400Updated 2 weeks ago
• XueFuzhao / InstructionWild
  ☆459Updated 9 months ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆151Updated 2 years ago
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆790Updated this week
• juncongmoo / minichatgpt
  minichatgpt - To Train ChatGPT In 5 Minutes
  ☆167Updated last year
• volcengine / veGiantModel
  ☆214Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆579Updated 8 months ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆805Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,382Updated last year
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆587Updated 6 months ago
• hpcaitech / SkyComputing
  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
  ☆90Updated 2 years ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆471Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆216Updated last year
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆580Updated 2 years ago
• feizc / MLE-LLaMA
  Multi-language Enhanced LLaMA
  ☆301Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆300Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆515Updated 10 months ago
• thaumstrial / FinetuneGLMWithPeft
  Simple implementation of using lora form the peft library to fine-tune the chatglm-6b
  ☆85Updated 2 years ago
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆469Updated last year
• Vahe1994 / SpQR
  ☆543Updated 3 months ago
• BlinkDL / RWKV-CUDA
  The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
  ☆221Updated 3 months ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• triton-inference-server / fastertransformer_backend
  ☆411Updated last year
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆646Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆309Updated 2 years ago