An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.
☆14Jan 9, 2024Updated 2 years ago
Alternatives and similar repositories for online-data-mixing
Users that are interested in online-data-mixing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆113Jul 15, 2025Updated last year
- ☆13Dec 12, 2025Updated 10 months ago
- Forcing Diffuse Distributions out of Language Models☆18Sep 10, 2024Updated 2 years ago
- The repository contains code for Adaptive Data Optimization☆37Dec 9, 2024Updated last year
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆40Dec 27, 2022Updated 3 years ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆80Nov 14, 2024Updated last year
- ☆18Mar 28, 2026Updated 6 months ago
- A Survey on Data Selection for Language Models☆261Apr 29, 2025Updated last year
- Exploration of automated dataset selection approaches at large scales.☆56Mar 4, 2025Updated last year
- [AAAI26] Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilitie…☆11Feb 7, 2026Updated 8 months ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆30Jul 23, 2025Updated last year
- ☆10Feb 6, 2025Updated last year
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆49Oct 31, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference☆18Mar 5, 2023Updated 3 years ago
- Code for our paper titled "Lens: Rethinking Multilingual Enhancement for Large Language Models"☆12Oct 15, 2024Updated 2 years ago
- Few-shot Learning with Auxiliary Data☆30Dec 8, 2023Updated 2 years ago
- 本项目主要使用deeplabv3+和yolov7对舌像进行识别,同时拥有基于知识图谱的多轮对话系统☆11Oct 12, 2024Updated 2 years ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆62Nov 26, 2023Updated 2 years ago
- Source code for a LoRA-based continual relation extraction method.☆14Sep 25, 2023Updated 3 years ago
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- ☆22Nov 20, 2020Updated 5 years ago
- Code for AAAI 2023 accepted paper titled "Knowledge-Bridged Causal Interaction Network for Causal Emotion Entailment"☆14May 6, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Source code for paper "On the Pareto Front of Multilingual Neural Machine Translation" @ NeurIPS 2023☆17Sep 27, 2023Updated 3 years ago
- f-PO: Generalizing Preference Optimization with f-divergence Minimization☆14Apr 2, 2025Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆83Apr 11, 2024Updated 2 years ago
- ☆12Nov 5, 2024Updated last year
- A curated list of awesome papers about calibration☆15May 6, 2024Updated 2 years ago
- Code for the paper: Rehearsal-free Continual Language Learning via Efficient Parameter Isolation☆13May 16, 2023Updated 3 years ago
- ☆12Mar 12, 2024Updated 2 years ago
- OpenDLM is an open-source library focused on sampling algorithms for Diffusion Language Models (DLMs).☆15Aug 5, 2025Updated last year
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆40May 28, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 【ICME2025 Oral】Offical Pytorch Code for "Fraesormer: Learning Adaptive Sparse Transformer for Efficient Food Recognition"☆13Mar 21, 2025Updated last year
- ☆14Aug 7, 2023Updated 3 years ago
- [NeurIPS 2026] Toward Skill-Native LLMs: Skill Entropy for Benchmarking and Training Long-Horizon Reasoning☆43Sep 25, 2026Updated 3 weeks ago
- This is the repository for our EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".☆10Jun 2, 2023Updated 3 years ago
- ☆61Jul 29, 2026Updated 2 months ago
- TL;DR: We propose a large-scale cross-domain persuasion dataset covers 13,000 scenarios in 35 domains, with the developed PersuGPT model …☆17Feb 12, 2025Updated last year
- Official code and dataset for our paper: RefineBench: Evaluating Refinement Capability of Language Models via Checklists☆16Dec 1, 2025Updated 10 months ago