tanyuqian / redcoLinks
NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
☆66Updated 6 months ago
Alternatives and similar repositories for redco
Users that are interested in redco are comparing it to the libraries listed below
Sorting:
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 8 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆76Updated last year
- Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"☆117Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆57Updated 2 months ago
- Vocabulary Parallelism☆19Updated 3 months ago
- ☆44Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- Odysseus: Playground of LLM Sequence Parallelism☆70Updated last year
- Elixir: Train a Large Language Model on a Small GPU Cluster☆15Updated 2 years ago
- ☆27Updated last year
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆60Updated 8 months ago
- ☆22Updated last year
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- ☆34Updated 2 years ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 9 months ago
- ☆47Updated 2 weeks ago
- ☆109Updated last year
- ☆74Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆95Updated last year
- ☆37Updated 9 months ago
- The evaluation framework for training-free sparse attention in LLMs☆69Updated last week
- Using FlexAttention to compute attention with different masking patterns☆44Updated 9 months ago
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆48Updated 2 years ago
- ☆126Updated last year
- ☆64Updated last year
- ☆96Updated 9 months ago
- [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.☆74Updated last year
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆116Updated 6 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆125Updated this week