Alternatives and similar repositories for redco:

Users that are interested in redco are comparing it to the libraries listed below

• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆71Updated 11 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆59Updated 5 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 6 months ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆32Updated last week
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆58Updated 2 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 9 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆66Updated 9 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆71Updated 6 months ago
• mayank31398 / ladder-residual-inference
  ☆12Updated 3 weeks ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆46Updated last year
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆56Updated 9 months ago
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆14Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• wdlctc / mini-s
  ☆49Updated 4 months ago
• sustcsonglin / mamba-triton
  ☆47Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆79Updated 9 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆42Updated 6 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆68Updated 10 months ago
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆114Updated last year
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆57Updated 6 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 5 months ago
• Infini-AI-Lab / gsm_infinite
  ☆36Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• prateeky2806 / ComPEFT
  ☆25Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆86Updated 2 months ago
• stanford-futuredata / stk
  ☆101Updated 7 months ago
• mgmalek / efficient_cross_entropy
  ☆95Updated 9 months ago