[NeurIPS'24 Spotlight] Observational Scaling Laws
☆63Oct 2, 2024Updated 2 years ago
Alternatives and similar repositories for ObsScaling
Users that are interested in ObsScaling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Language models scale reliably with over-training and on downstream tasks☆104Apr 2, 2024Updated 2 years ago
- Efficient Scaling laws and collaborative pretraining.☆24Jul 19, 2026Updated 3 months ago
- Fluent student-teacher redteaming☆23Jul 25, 2024Updated 2 years ago
- A package dedicated for running benchmark agreement testing☆19Sep 18, 2025Updated last year
- Open-source audio embedding models, submitted to the HEAR 2021 challenge☆11Feb 15, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- [TMLR 25] An automated method for explaining complex neuron behaviors in deep vision models using large language models☆12Feb 20, 2025Updated last year
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆153Sep 20, 2024Updated 2 years ago
- 🧭 SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages☆13Feb 12, 2025Updated last year
- A toolkit for scaling law research ⚖☆70Jan 27, 2025Updated last year
- ☆65Apr 9, 2024Updated 2 years ago
- An Affordable LLM Pre-training Benchmark via Accurate Loss Prediction across Scales☆16Jun 6, 2024Updated 2 years ago
- Official repository for RePro: Training Language Models to Faithfully Recycle the Web for Pretraining☆11Feb 18, 2026Updated 8 months ago
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Dec 30, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆85Apr 10, 2023Updated 3 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆17Apr 15, 2024Updated 2 years ago
- ☆16Apr 13, 2024Updated 2 years ago
- Code for "Reasoning to Learn from Latent Thoughts"☆135Mar 28, 2025Updated last year
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆89Jul 28, 2024Updated 2 years ago
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆33Jul 17, 2023Updated 3 years ago
- ☆17Feb 4, 2025Updated last year
- The offical implementation of DeMix (Decouple Searching from Training: Scaling Data Mixing via Model Merging for Large Language Model Pre…☆46May 18, 2026Updated 5 months ago
- ☆12Oct 10, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A simple model for predicting soccer outcomes☆11Jul 12, 2024Updated 2 years ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆84May 2, 2025Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆44Dec 29, 2025Updated 10 months ago
- ☆62Mar 9, 2023Updated 3 years ago
- Experiments from "The Generalization-Stability Tradeoff in Neural Network Pruning": https://arxiv.org/abs/1906.03728.☆14Oct 23, 2020Updated 6 years ago
- A formalisation of Cartesian Frames, a perspective on embedded agency, in the HOL theorem prover.☆22Dec 20, 2021Updated 4 years ago
- When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).☆11Jan 30, 2025Updated last year
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆94Oct 30, 2024Updated 2 years ago
- ☆11Apr 2, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A Kubernetes sandbox environment for use with inspect_ai☆42Updated this week
- [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.☆27Oct 27, 2023Updated 3 years ago
- Silly twitter torch implementations.☆48Oct 14, 2022Updated 4 years ago
- ☆44May 23, 2023Updated 3 years ago
- Evaluating Data Attribution for Text-to-Image Models: a visual data attribution benchmark for evaluating and learning training image inf…☆80Jun 25, 2024Updated 2 years ago
- ☆50Oct 24, 2023Updated 3 years ago
- Implementation and evaluation of the RL algorithm Rainbow to learn to play Atari games.☆10Aug 19, 2020Updated 6 years ago