SakanaAI / evo-memory
Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
☆11Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for evo-memory
- ☆24Updated 6 months ago
- ☆12Updated 3 months ago
- ☆17Updated 4 months ago
- We develop world models that can be adapted with natural language. Intergrating these models into artificial agents allows humans to effe…☆19Updated 9 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆25Updated last year
- Repo to reproduce the First-Explore paper results☆36Updated last week
- Repository for Skill Set Optimization☆12Updated 3 months ago
- Efficient Scaling laws and collaborative pretraining.☆13Updated 3 weeks ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆11Updated this week
- ☆25Updated 3 weeks ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆24Updated 6 months ago
- ☆50Updated 2 weeks ago
- this is for fun, ain't it grand!☆12Updated 6 months ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆20Updated last week
- DPO, but faster 🚀☆21Updated 2 weeks ago
- Self-Supervised Alignment with Mutual Information☆14Updated 5 months ago
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆45Updated 5 months ago
- GoldFinch and other hybrid transformer components☆39Updated 3 months ago
- ☆25Updated 2 weeks ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 9 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- A repository for research on medium sized language models.☆74Updated 5 months ago
- ☆44Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated 2 weeks ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated 11 months ago
- Lottery Ticket Adaptation☆36Updated last month
- Code for paper - On Diversified Preferences of Large Language Model Alignment☆14Updated 3 months ago
- Dateset Reset Policy Optimization☆28Updated 7 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆65Updated 4 months ago
- ☆26Updated 4 months ago