Tufalabs / BeyondNextTokenPrediction
☆14Updated 3 weeks ago
Alternatives and similar repositories for BeyondNextTokenPrediction:
Users that are interested in BeyondNextTokenPrediction are comparing it to the libraries listed below
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆24Updated 2 months ago
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated 3 weeks ago
- Official implementation of ECCV24 paper: POA☆24Updated 8 months ago
- ☆33Updated 9 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- ☆24Updated 6 months ago
- ☆48Updated 5 months ago
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated 2 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated 2 weeks ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- Exploration of automated dataset selection approaches at large scales.☆37Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆30Updated last month
- Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.☆29Updated 2 weeks ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆28Updated last month
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆25Updated 5 months ago
- ☆31Updated 3 months ago
- Lottery Ticket Adaptation☆39Updated 4 months ago
- ☆24Updated 3 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆23Updated 3 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 9 months ago
- ☆44Updated 11 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- The repository contains code for Adaptive Data Optimization☆21Updated 4 months ago