hpcaitech / PaLM-colossalai

Related projects ⓘ

Alternatives and complementary repositories for PaLM-colossalai

• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆196Updated 2 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆109Updated 7 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆283Updated last year
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆336Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆560Updated last month
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆111Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆206Updated 9 months ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆460Updated 2 years ago
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆352Updated 5 months ago
• AI21Labs / Parallel-Context-Windows
  ☆102Updated last year
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆253Updated 2 months ago
• qhliu26 / Dive-into-Big-Model-Training
  📑 Dive into Big Model Training
  ☆110Updated last year
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆352Updated last week
• Dahoas / reward-modeling
  ☆94Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆227Updated 7 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆117Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated last year
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆184Updated 3 weeks ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆522Updated last month
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆74Updated 3 weeks ago
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆89Updated last year
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆96Updated this week
• alibaba / ChatLearn
  ☆198Updated this week
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆67Updated 3 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆58Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆305Updated last year
• triton-inference-server / fastertransformer_backend
  ☆411Updated 11 months ago