thepowerfuldeez / sample_efficient_gptLinks
Training framework with a goal to explore the frontier of sample efficiency of small language models
☆78Updated last week
Alternatives and similar repositories for sample_efficient_gpt
Users that are interested in sample_efficient_gpt are comparing it to the libraries listed below
Sorting:
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆111Updated last month
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Updated 7 months ago
- Simple repository for training small reasoning models☆45Updated 9 months ago
- Simple GRPO scripts and configurations.☆59Updated 9 months ago
- rl from zero pretrain, can it be done? yes.☆280Updated last month
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 2 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 7 months ago
- ☆58Updated this week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆107Updated 8 months ago
- Exploring Applications of GRPO☆248Updated 2 months ago
- A collection of lightweight interpretability scripts to understand how LLMs think☆66Updated this week
- 📄Small Batch Size Training for Language Models☆63Updated last month
- Jax like function transformation engine but micro, microjax☆33Updated last year
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 8 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆59Updated last month
- Code for☆27Updated 11 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- LLM training in simple, raw C/CUDA☆15Updated 11 months ago
- ☆32Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- ☆91Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆173Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- ☆38Updated 7 months ago
- ☆106Updated last month
- ☆28Updated last year
- H-Net Dynamic Hierarchical Architecture☆80Updated 2 months ago
- ☆26Updated 10 months ago
- ☆48Updated last year
- Collection of autoregressive model implementation☆86Updated 6 months ago