Shaping capabilities with token-level pretraining data filtering
☆98Jan 28, 2026Updated 9 months ago
Alternatives and similar repositories for token-filtering
Users that are interested in token-filtering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code repository for Group-MATES Group-Level Data Selection for Efficient Pretraining☆13Jun 14, 2025Updated last year
- ☆16Nov 12, 2026Updated last week
- ☆14Dec 12, 2025Updated 11 months ago
- ☆31Jan 7, 2026Updated 10 months ago
- ☆20Jun 3, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”…☆25Aug 13, 2026Updated 3 months ago
- ☆12Feb 25, 2026Updated 8 months ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- open Source code for propensity evaluation☆22Apr 25, 2026Updated 6 months ago
- Official Implementation of Knowledge Flow Prompting☆35Oct 20, 2025Updated last year
- [ICLR 26] The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".☆19Feb 9, 2026Updated 9 months ago
- No-chain-of-thought reasoning benchmark (NCRI): sealed banks, no-CoT runner with witnesses, frozen placement, scores for 285 models☆29Nov 9, 2026Updated last week
- [ICML 2026] Public repository for fine-tuning Masked Diffusion Models toward provable self-correction.☆27Jul 5, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆44Oct 24, 2026Updated 3 weeks ago
- Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)☆24Oct 24, 2023Updated 3 years ago
- Hugging Face Jobs☆20Jul 11, 2025Updated last year
- [NeurIPS 2025] Intervene-All-Paths: Unified Mitigation of LVLM Hallucinations across Alignment Formats☆12Dec 5, 2025Updated 11 months ago
- ☆17Jan 27, 2026Updated 9 months ago
- Code and results on finding one-shot steering vectors that mediate emergent misalignment☆12Apr 12, 2025Updated last year
- [ICML 2026 Spotlight] On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models☆171Jun 8, 2026Updated 5 months ago
- Reproducible, flexible LLM evaluations☆413Mar 24, 2026Updated 7 months ago
- Codebase for paper: "Counterfactual Simulation Training for Chain-of-Thought Faithfulness"☆19Jun 18, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Convert your language model into a byte-level one!☆14Feb 26, 2026Updated 8 months ago
- (ICLR Oral) DiSF Combatting Dimensional Collapse in LLM Pre-training Data via Diversified File Selection☆10May 9, 2025Updated last year
- Internalizing steering vectors via fine tuning☆12Sep 6, 2024Updated 2 years ago
- ☆20May 26, 2026Updated 5 months ago
- ☆12Oct 23, 2022Updated 4 years ago
- ☆19Mar 10, 2026Updated 8 months ago
- Repository of <FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models> in EMNLP 2026 Findings☆76Aug 24, 2026Updated 2 months ago
- Goldfish: Monolingual language models for 350 languages.☆29Mar 4, 2026Updated 8 months ago
- ☆44May 26, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MixtureVitae: A Permissive, High-Performance, Open-Access Pretraining Dataset☆10Jun 6, 2026Updated 5 months ago
- Structured Primitives for Efficient Architecture Research☆22Dec 22, 2025Updated 10 months ago
- A local, multimodal embedding server and vector database using NVIDIA's Omni-Embed-Nemotron-3B. This project allows you to generate embed…☆11Nov 27, 2025Updated 11 months ago
- Code for our ICML 2024 paper "Aligning Transformers with Weisfeiler-Leman"☆11Jun 9, 2024Updated 2 years ago
- ☆15Sep 23, 2026Updated last month
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 4 months ago
- [ECCV 2024] Official PyTorch implementation of "HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts"☆20Nov 22, 2024Updated last year
Are these results useful?