Shaping capabilities with token-level pretraining data filtering
☆97Jan 28, 2026Updated 8 months ago
Alternatives and similar repositories for token-filtering
Users that are interested in token-filtering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Sep 24, 2026Updated 2 weeks ago
- ☆13Dec 12, 2025Updated 9 months ago
- ☆30Jan 7, 2026Updated 9 months ago
- Official Implementation of Knowledge Flow Prompting☆35Oct 20, 2025Updated 11 months ago
- [ICLR 26] The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".☆19Feb 9, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)☆24Oct 24, 2023Updated 2 years ago
- [ICML 2026] Public repository for fine-tuning Masked Diffusion Models toward provable self-correction.☆26Jul 5, 2026Updated 3 months ago
- Official PyTorch Implementation for Learning a Generative Meta-Model of LLM Activations, ICML 2026☆97Sep 12, 2026Updated 3 weeks ago
- Repository for "Training Language Models To Explain Their Own Computations"☆38Jul 7, 2026Updated 3 months ago
- Hugging Face Jobs☆20Jul 11, 2025Updated last year
- [ICML 2026 Spotlight] On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models☆168Jun 8, 2026Updated 4 months ago
- ☆20May 26, 2026Updated 4 months ago
- Reproducible, flexible LLM evaluations☆399Mar 24, 2026Updated 6 months ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- Goldfish: Monolingual language models for 350 languages.☆28Mar 4, 2026Updated 7 months ago
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆15Jun 16, 2023Updated 3 years ago
- [ECCV 2024] Official PyTorch implementation of "HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts"☆20Nov 22, 2024Updated last year
- ☆42May 26, 2026Updated 4 months ago
- Repository of <FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models> in EMNLP 2026 Findings☆76Aug 24, 2026Updated last month
- ☆21Mar 16, 2026Updated 6 months ago
- A flow matching model that uses data-driven geometric noise to improve the quality-generalisation tradeoff and to reduce memorisation.☆21Apr 7, 2026Updated 6 months ago
- Structured Primitives for Efficient Architecture Research☆21Dec 22, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Benchmarking Dark Patterns in LLMs (ICLR 2025)☆19Mar 29, 2025Updated last year
- ☆15Sep 23, 2026Updated 2 weeks ago
- Inference API for many LLMs and other useful tools for empirical research☆136May 29, 2026Updated 4 months ago
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆73Jan 26, 2026Updated 8 months ago
- Data Efficacy for Language Model Training☆53May 29, 2026Updated 4 months ago
- open Source code for propensity evaluation☆21Apr 25, 2026Updated 5 months ago
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 3 months ago
- Unified access to Large Language Model modules using NNsight☆121Updated this week
- ☆13Jun 16, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Aurora optimizer release☆157Jul 18, 2026Updated 2 months ago
- ☆15Updated this week
- A tiny package supporting distributed computation of COCO metrics for PyTorch models.☆15Feb 28, 2023Updated 3 years ago
- The repository contains code for Adaptive Data Optimization☆37Dec 9, 2024Updated last year
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆361Aug 21, 2026Updated last month
- This tool uses Ethereum's peer-discovery protocol to measure the size of the Ethereum network (testnets included)☆15Dec 15, 2022Updated 3 years ago
- Python client for Google Kaniko☆11Jul 19, 2022Updated 4 years ago