corl-team / rebasedLinks
Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"
☆160Updated 4 months ago
Alternatives and similar repositories for rebased
Users that are interested in rebased are comparing it to the libraries listed below
Sorting:
- ☆71Updated 9 months ago
- ☆20Updated 10 months ago
- Effective LLM Alignment Toolkit☆131Updated 3 weeks ago
- σ-GPT: A New Approach to Autoregressive Models☆64Updated 9 months ago
- ☆53Updated last year
- ☆14Updated last week
- Fast modular code to create and train cutting edge LLMs☆66Updated last year
- A benchmark for role-playing language models☆96Updated last week
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆126Updated 9 months ago
- ☆31Updated 8 months ago
- Focused on fast experimentation and simplicity☆73Updated 5 months ago
- Understand and test language model architectures on synthetic tasks.☆197Updated 3 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆100Updated 2 months ago
- ☆46Updated last month
- RWKV-7: Surpassing GPT☆88Updated 6 months ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆62Updated 7 months ago
- supporting pytorch FSDP for optimizers☆79Updated 5 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆100Updated 5 months ago
- Framework for processing and filtering datasets☆27Updated 10 months ago
- 2D Positional Embeddings for Webpage Structural Understanding 🦙👀☆94Updated 9 months ago
- ☆13Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆128Updated 3 weeks ago
- ☆22Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆66Updated last month
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆42Updated 2 months ago
- Evalica, your favourite evaluation toolkit☆37Updated 2 weeks ago
- ☆49Updated last year
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆93Updated 10 months ago
- Normalized Transformer (nGPT)☆181Updated 6 months ago
- PyTorch implementation of models from the Zamba2 series.☆182Updated 4 months ago