Alternatives and similar repositories for PaLM-colossalai:

Users that are interested in PaLM-colossalai are comparing it to the libraries listed below

• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆207Updated 7 months ago
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆339Updated 2 years ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆562Updated 5 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆300Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• AI21Labs / Parallel-Context-Windows
  ☆104Updated last year
• Dahoas / reward-modeling
  ☆96Updated last year
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆587Updated 6 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆116Updated last year
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆216Updated last year
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆110Updated 2 years ago
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆92Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆515Updated 10 months ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆151Updated 2 years ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆313Updated 6 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆244Updated 11 months ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆309Updated 2 years ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆95Updated last year
• hpcaitech / EnergonAI
  Large-scale model inference.
  ☆628Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆95Updated last year
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆198Updated 4 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆463Updated 2 weeks ago
• SqueezeAILab / KVQuant
  [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
  ☆338Updated 7 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆335Updated 6 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆190Updated this week