(ICLR Oral) DiSF Combatting Dimensional Collapse in LLM Pre-training Data via Diversified File Selection
☆11May 9, 2025Updated last year
Alternatives and similar repositories for DiSF
Users that are interested in DiSF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Joint Selection for Large-Scale Pre-Training Data via Policy Gradient-based Mask Learning☆22Jan 4, 2026Updated 10 months ago
- Implementation and evaluation of Scaling Embedding Layers in Language Models research paper☆18Feb 2, 2026Updated 9 months ago
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- Code repository for Group-MATES Group-Level Data Selection for Efficient Pretraining☆13Jun 14, 2025Updated last year
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ICLR 2023] PyTorch implementation for "Long-Tailed Partial Label Learning via Dynamic Rebalancing"☆58Apr 21, 2023Updated 3 years ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated 2 years ago
- [NeurIPS 2023]Federated Learning with Bilateral Curation for Partially Class-Disjoint Data☆15Aug 1, 2025Updated last year
- ☆17Nov 1, 2024Updated 2 years ago
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Jun 22, 2023Updated 3 years ago
- This repository experiments with Smart "Predict, then Optimize" framework in the context of portfolio optimization.☆10Sep 23, 2023Updated 3 years ago
- Multi-GPU supported kmeans clustering for cluser-clip☆15Jun 3, 2024Updated 2 years ago
- DOFEN is a novel tree-inspired deep tabular neural network, accepted by NeurIPS 2024☆13Dec 17, 2024Updated last year
- This code accompanies the paper DeePM: Regime-Robust Deep Learning for Systematic Macro Portfolio Management (https://arxiv.org/abs/2601.…☆25Mar 19, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Phenotype Associated Spatial Signature Analysis with Graph-based Embedding☆27Mar 5, 2025Updated last year
- ☆20Feb 2, 2026Updated 9 months ago
- ☆13Jul 14, 2022Updated 4 years ago
- [NeurIPS 2025] This is the official repository for "RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis"☆27Nov 21, 2025Updated 11 months ago
- Multi-task end-to-end predict-then-optimize☆15Apr 28, 2023Updated 3 years ago
- [TPAMI 2026] This is the official repository for "LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models"☆29Sep 29, 2026Updated last month
- Few-shot Learning with Auxiliary Data☆30Dec 8, 2023Updated 2 years ago
- 论文Reinforcement Learning of Sequential Price Mechanisms的复现☆12Nov 3, 2022Updated 4 years ago
- notes for NJU courses☆18Oct 26, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Mar 12, 2026Updated 7 months ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆26Nov 16, 2023Updated 2 years ago
- Fake Trump's faces generated by GAN, study only☆10Oct 6, 2020Updated 6 years ago
- The CS241 Course of Shanghai Jiao Tong University☆10Dec 28, 2019Updated 6 years ago
- [ICML 2024 spotlight] This repository contains the implementation details for the paper "Locally Estimated Global Perturbations are Bette…☆26Jul 29, 2024Updated 2 years ago
- This is the package used to calculate the similarity index of the label graph pairs.☆13Nov 4, 2020Updated 6 years ago
- ☆33May 9, 2025Updated last year
- cuPIQP: batched and differentiable proximal-interior-point-method QP solver on GPU☆42Updated this week
- ☆11May 14, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Jun 12, 2022Updated 4 years ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- The PackNet Continual Learning Method in Pytorch☆15Aug 19, 2021Updated 5 years ago
- Official Implementation of ConceptLM.☆34Mar 18, 2026Updated 7 months ago
- [ICLR 2023] "Combating Exacerbated Heterogeneity for Robust Models in Federated Learning"☆31Dec 28, 2025Updated 10 months ago
- ☆12Jun 20, 2024Updated 2 years ago
- Data Efficacy for Language Model Training☆55Oct 10, 2026Updated 3 weeks ago