facebookresearch / searchformer
Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".
☆365Updated 10 months ago
Alternatives and similar repositories for searchformer:
Users that are interested in searchformer are comparing it to the libraries listed below
- LLM verified with Monte Carlo Tree Search☆275Updated last month
- Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind☆374Updated 2 months ago
- LeanRL is a fork of CleanRL, where selected PyTorch scripts optimized for performance using compile and cudagraphs.☆559Updated 6 months ago
- ☆241Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆608Updated last month
- Fine-tune LLM agents with online reinforcement learning☆1,137Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆123Updated 2 weeks ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆283Updated last week
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆204Updated 5 months ago
- Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model tra…☆150Updated last year
- Visualize the intermediate output of Mistral 7B☆360Updated 3 months ago
- a curated list of data for reasoning ai☆136Updated 9 months ago
- Understanding R1-Zero-Like Training: A Critical Perspective☆908Updated 3 weeks ago
- Open weights language model from Google DeepMind, based on Griffin.☆636Updated 2 months ago
- ☆141Updated last week
- An implementation of bucketMul LLM inference☆217Updated 10 months ago
- Cost aware hyperparameter tuning algorithm☆151Updated 10 months ago
- LLM Analytics☆658Updated 6 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆251Updated last year
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆202Updated 7 months ago
- Diffusion on syntax trees for program synthesis☆456Updated 10 months ago
- a small code base for training large models☆297Updated last week
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆464Updated last year
- run paligemma in real time☆131Updated 11 months ago
- Autograd to GPT-2 completely from scratch☆113Updated 2 weeks ago
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆228Updated 6 months ago
- Grandmaster-Level Chess Without Search☆573Updated 3 months ago
- An interactive HTML pretty-printer for machine learning research in IPython notebooks.☆412Updated last week
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆305Updated 6 months ago
- procedural reasoning datasets☆573Updated last week