nano-R1 / resourcesLinks
Compiling useful links, papers, benchmarks, ideas, etc.
☆46Updated 9 months ago
Alternatives and similar repositories for resources
Users that are interested in resources are comparing it to the libraries listed below
Sorting:
- rl from zero pretrain, can it be done? yes.☆286Updated 3 months ago
- ☆116Updated last week
- Simple Transformer in Jax☆140Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆109Updated 10 months ago
- MoE training for Me and You and maybe other people☆315Updated last week
- Curated collection of community environments☆200Updated last week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆174Updated 11 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Updated 8 months ago
- Simple repository for training small reasoning models☆47Updated 11 months ago
- Storing long contexts in tiny caches with self-study☆229Updated last month
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆65Updated 8 months ago
- Open source interpretability artefacts for R1.☆165Updated 8 months ago
- An introduction to LLM Sampling☆79Updated last year
- train entropix like a champ!☆20Updated last year
- smolLM with Entropix sampler on pytorch☆149Updated last year
- SIMD quantization kernels☆92Updated 4 months ago
- ☆68Updated 7 months ago
- Exploring Applications of GRPO☆252Updated 4 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Updated 4 months ago
- Train your own SOTA deductive reasoning model☆107Updated 10 months ago
- ☆27Updated last year
- smol models are fun too☆93Updated last year
- ☆135Updated 9 months ago
- ☆131Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆125Updated 3 months ago
- ☆150Updated 4 months ago
- Plotting (entropy, varentropy) for small LMs☆99Updated 7 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆87Updated 9 months ago
- A collection of lightweight interpretability scripts to understand how LLMs think☆88Updated last week
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated last year