The-Swarm-Corporation / StatisticalModelEvaluatorLinks
An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"
☆16Updated last month
Alternatives and similar repositories for StatisticalModelEvaluator
Users that are interested in StatisticalModelEvaluator are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last month
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆35Updated last year
- Simple GRPO scripts and configurations.☆59Updated 9 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated 2 years ago
- A sample pattern for running CI tests on Modal☆18Updated 7 months ago
- ☆55Updated last year
- ☆20Updated last month
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated last week
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 5 months ago
- Collection of autoregressive model implementation☆86Updated 6 months ago
- ☆40Updated last year
- ☆39Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated 2 years ago
- Lottery Ticket Adaptation☆40Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Simple repository for training small reasoning models☆45Updated 9 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆29Updated 3 months ago
- A repository for research on medium sized language models.☆78Updated last year
- Aioli: A unified optimization framework for language model data mixing☆28Updated 10 months ago
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- DPO, but faster 🚀☆46Updated 11 months ago
- Utilities for Training Very Large Models☆58Updated last year
- ☆86Updated last year