The-Swarm-Corporation / StatisticalModelEvaluator
An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"
☆15Updated 3 weeks ago
Alternatives and similar repositories for StatisticalModelEvaluator:
Users that are interested in StatisticalModelEvaluator are comparing it to the libraries listed below
- ☆48Updated 3 months ago
- Latent Large Language Models☆17Updated 5 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 11 months ago
- NanoGPT (124M) quality in 2.67B tokens☆27Updated this week
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 3 months ago
- Example code using the DSPy framework.☆18Updated 8 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated 8 months ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆30Updated last week
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆14Updated 11 months ago
- ☆21Updated 2 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 2 months ago
- ☆14Updated 4 months ago
- ☆47Updated 5 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆40Updated 10 months ago
- ☆20Updated 8 months ago
- Minimum Description Length probing for neural network representations☆18Updated 3 weeks ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆54Updated 5 months ago
- Measuring and Controlling Persona Drift in Language Model Dialogs☆16Updated 11 months ago
- PyTorch implementation for MRL☆18Updated 11 months ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆13Updated last month
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated last week