TobiasNorlund / retroLinks
Official repo to On the Generalization Ability of Retrieval-Enhanced Transformers
☆44Updated last year
Alternatives and similar repositories for retro
Users that are interested in retro are comparing it to the libraries listed below
Sorting:
- [NeurIPS'23] Speculative Decoding with Big Little Decoder☆94Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆201Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆96Updated 2 years ago
- ☆122Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆135Updated last year
- ☆52Updated 11 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆146Updated last year
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆155Updated 6 months ago
- ☆76Updated last year
- ☆39Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆89Updated 2 months ago
- ☆149Updated 2 years ago
- Code repository for the c-BTM paper☆107Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆240Updated 4 months ago
- Code for Zero-Shot Tokenizer Transfer☆137Updated 8 months ago
- Easy-to-use Retrieval-Enhanced Transformer implementation☆10Updated 3 years ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated last year
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆107Updated 6 months ago
- ☆34Updated 2 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- ☆128Updated last year
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆70Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆116Updated 2 years ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated 11 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- Experiments on speculative sampling with Llama models☆128Updated 2 years ago
- Explorations into some recent techniques surrounding speculative decoding☆288Updated 9 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆274Updated last year
- Randomized Positional Encodings Boost Length Generalization of Transformers☆82Updated last year