The-Swarm-Corporation / StatisticalModelEvaluatorLinks
An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"
☆16Updated 3 weeks ago
Alternatives and similar repositories for StatisticalModelEvaluator
Users that are interested in StatisticalModelEvaluator are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last week
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆35Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated 2 years ago
- ☆55Updated 11 months ago
- Simple GRPO scripts and configurations.☆59Updated 8 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- Latent Large Language Models☆19Updated last year
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆28Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- Aioli: A unified optimization framework for language model data mixing☆28Updated 9 months ago
- A sample pattern for running CI tests on Modal☆18Updated 6 months ago
- Simple repository for training small reasoning models☆44Updated 8 months ago
- ☆40Updated last year
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated last week
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 4 months ago
- Minimum Description Length probing for neural network representations☆20Updated 9 months ago
- Collection of autoregressive model implementation☆86Updated 6 months ago
- ☆48Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- ☆45Updated 2 months ago
- A collection of lightweight interpretability scripts to understand how LLMs think☆61Updated this week
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆31Updated last year
- ☆50Updated 8 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆26Updated last year
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆28Updated 4 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 6 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year