nano-R1 / resources
Compiling useful links, papers, benchmarks, ideas, etc.
☆41Updated last week
Alternatives and similar repositories for resources:
Users that are interested in resources are comparing it to the libraries listed below
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 2 weeks ago
- look how they massacred my boy☆63Updated 5 months ago
- Simple Transformer in Jax☆136Updated 9 months ago
- ☆106Updated this week
- Train your own SOTA deductive reasoning model☆81Updated 2 weeks ago
- ☆38Updated 7 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆52Updated last week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆168Updated 2 months ago
- An introduction to LLM Sampling☆77Updated 3 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated last month
- ☆27Updated 8 months ago
- smolLM with Entropix sampler on pytorch☆150Updated 4 months ago
- train entropix like a champ!☆20Updated 5 months ago
- Simple GRPO scripts and configurations.☆58Updated last month
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆97Updated this week
- ☆97Updated 5 months ago
- smol models are fun too☆90Updated 4 months ago
- code for training & evaluating Contextual Document Embedding models☆176Updated 2 months ago
- ☆111Updated last month
- minimal GRPO implementation from scratch☆62Updated last week
- PageRank for LLMs☆39Updated 3 weeks ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆50Updated 4 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 4 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆83Updated this week
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 5 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆167Updated this week
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆83Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆100Updated 4 months ago
- Official repo of paper LM2☆34Updated last month