Alternatives and similar repositories for ColossalAI-Examples

Users that are interested in ColossalAI-Examples are comparing it to the libraries listed below

• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 2 years ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆565Updated 11 months ago
• hpcaitech / EnergonAI
  Large-scale model inference.
  ☆632Updated 2 years ago
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆589Updated 2 years ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆408Updated last month
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆188Updated 2 years ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆416Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆609Updated last month
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,418Updated last year
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆151Updated 2 years ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆812Updated 2 years ago
• XueFuzhao / InstructionWild
  ☆460Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆536Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆224Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆381Updated last year
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆472Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆533Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆657Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆308Updated 2 years ago
• BlinkDL / RWKV-CUDA
  The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
  ☆223Updated 9 months ago
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• THUDM / SwissArmyTransformer
  SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
  ☆1,089Updated 9 months ago
• feizc / MLE-LLaMA
  Multi-language Enhanced LLaMA
  ☆302Updated 2 years ago
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆165Updated 2 years ago
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 3 years ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆97Updated last year
• triton-inference-server / fastertransformer_backend
  ☆412Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆314Updated 2 years ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆989Updated last year
• Tencent / PatrickStar
  PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
  ☆767Updated 2 years ago