SakanaAI / evo-memory
Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
☆11Updated last month
Related projects ⓘ
Alternatives and complementary repositories for evo-memory
- ☆13Updated 4 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated 11 months ago
- Repository for Skill Set Optimization☆12Updated 3 months ago
- A repository for research on medium sized language models.☆74Updated 6 months ago
- ☆24Updated 7 months ago
- GoldFinch and other hybrid transformer components☆40Updated 4 months ago
- Efficient Scaling laws and collaborative pretraining.☆13Updated last week
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- We develop world models that can be adapted with natural language. Intergrating these models into artificial agents allows humans to effe…☆19Updated 9 months ago
- Code for the "Cultural evolution in populations of Large Language Models" paper☆28Updated 3 weeks ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆21Updated 3 weeks ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated 3 weeks ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- ☆22Updated 2 weeks ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 10 months ago
- ☆18Updated 2 weeks ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆24Updated 7 months ago
- Lottery Ticket Adaptation☆37Updated this week
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- DPO, but faster 🚀☆23Updated 3 weeks ago
- ☆25Updated 3 weeks ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆30Updated last month
- ☆53Updated 3 weeks ago
- ☆28Updated 5 months ago
- ☆55Updated last month
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆13Updated this week
- We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.☆13Updated this week
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆25Updated 4 months ago
- ☆62Updated 3 months ago
- this is for fun, ain't it grand!☆12Updated 7 months ago