Measuring the Signal to Noise Ratio in Language Model Evaluation
☆31Aug 19, 2025Updated 10 months ago
Alternatives and similar repositories for signal-and-noise
Users that are interested in signal-and-noise are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10May 16, 2024Updated 2 years ago
- ☆34Jun 21, 2024Updated 2 years ago
- ☆10Jun 27, 2024Updated 2 years ago
- Object-Centric-Representation Library (OCRL): This repo is to explore OCR on various downstream tasks from supervised learning tasks to R…☆12Feb 23, 2024Updated 2 years ago
- ☆16Jul 16, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Directed masked autoencoders☆14Mar 25, 2026Updated 3 months ago
- Official Implementation of `An Optimisation Framework for Unsupervised Environment Design` from RLC 2025☆17Nov 24, 2025Updated 7 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆32Nov 4, 2024Updated last year
- Reinforcement Learning inside a 3D soccer simulation☆38Sep 15, 2024Updated last year
- VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)☆29Jan 14, 2025Updated last year
- [ICML 2025 GenBio Workshop] Official Implementation for "Electrostatics from Laplacian Eigenbasis for Neural Network Interatomic Potentia…☆18Jun 12, 2025Updated last year
- Pointax: PointMaze Environment for JAX☆28Oct 22, 2025Updated 8 months ago
- Official implementation of "Latent Action Learning Requires Supervision in the Presence of Distractors", ICML 2025☆38Jul 8, 2025Updated last year
- Minimal RLHF implementation built on top of minGPT.☆32Jul 4, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25May 20, 2025Updated last year
- Fluid Language Model Benchmarking☆29Sep 16, 2025Updated 9 months ago
- ☆68Apr 8, 2026Updated 3 months ago
- ☆19Apr 22, 2024Updated 2 years ago
- Official codebase for "Sampling For Learnability", published at NeurIPS 2024☆24Oct 21, 2025Updated 8 months ago
- [ICLR 26] The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".☆18Feb 9, 2026Updated 5 months ago
- Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"☆32Oct 12, 2023Updated 2 years ago
- ☆17Aug 20, 2025Updated 10 months ago
- Code of the Paper "Time-Efficient Reinforcement Learning with Stochastic Stateful Policies"☆25May 5, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Jul 4, 2025Updated last year
- The loss landscape of Large Language Models resemble basin!☆41Jul 8, 2025Updated last year
- High-performance JAX-powered simulator for robotic navigation in 2D mazes, optimized for Quality-Diversity algorithm research and benchma…☆20Jun 19, 2025Updated last year
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence☆68Nov 11, 2025Updated 7 months ago
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- Data-Driven NetHack Tools: Datasets (30+) and recurrent-baselines (AWAC, BC, CQL, IQL, REM)☆43Aug 22, 2023Updated 2 years ago
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆22Nov 25, 2024Updated last year
- ☆72Nov 15, 2024Updated last year
- ☆19Mar 1, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Mitigating Partial Observability in Sequential Decision Processes via the Lambda Discrepancy☆24Oct 28, 2024Updated last year
- [NeurIPS 2025] Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang L…☆72Mar 3, 2026Updated 4 months ago
- minimal Energy-based transformer☆44Dec 11, 2025Updated 6 months ago
- A dataloader, but for JAX☆20May 17, 2024Updated 2 years ago
- ☆30Apr 28, 2026Updated 2 months ago
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆22Jan 11, 2026Updated 5 months ago
- ☆17Jul 24, 2023Updated 2 years ago