hpcaitech / PaLM-colossalai

Related projects ⓘ

Alternatives and complementary repositories for PaLM-colossalai

• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆195Updated 3 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆284Updated last year
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆336Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆206Updated 10 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆111Updated 8 months ago
• AI21Labs / Parallel-Context-Windows
  ☆102Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆560Updated last month
• Dahoas / reward-modeling
  ☆94Updated last year
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆176Updated last month
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆211Updated last year
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆98Updated last week
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆525Updated last month
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆254Updated 2 months ago
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆355Updated last week
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆150Updated last year
• stanford-futuredata / stk
  ☆88Updated 2 months ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆111Updated last year
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆285Updated last month
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆75Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆230Updated 7 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆357Updated this week
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆89Updated last year
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆86Updated 9 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆281Updated last week
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆76Updated last month
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆306Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆321Updated last month
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆68Updated 4 months ago