The-Swarm-Corporation / StatisticalModelEvaluator
An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"
☆16Updated last month
Alternatives and similar repositories for StatisticalModelEvaluator
Users that are interested in StatisticalModelEvaluator are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 3 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆23Updated last month
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- LLM training in simple, raw C/CUDA☆14Updated 5 months ago
- Latent Large Language Models☆18Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last month
- ☆48Updated 6 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆16Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆37Updated last year
- Verifiers for LLM Reinforcement Learning☆53Updated last month
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Minimum Description Length probing for neural network representations☆19Updated 3 months ago
- ☆20Updated 2 weeks ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆43Updated last year
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 7 months ago
- Official Repository for Task-Circuit Quantization☆20Updated 3 weeks ago
- Lego for GRPO☆28Updated last month
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- ☆18Updated 7 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated last month
- ☆26Updated last year
- Simple repository for training small reasoning models☆28Updated 3 months ago
- Apps that run on modal.com☆12Updated 11 months ago
- ☆43Updated 3 months ago
- ☆50Updated 6 months ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆16Updated last year
- ☆38Updated 9 months ago
- ☆9Updated 3 weeks ago