carlini / yet-another-applied-llm-benchmark
A benchmark to evaluate language models on questions I've previously asked them to solve.
☆949Updated 2 months ago
Alternatives and similar repositories for yet-another-applied-llm-benchmark:
Users that are interested in yet-another-applied-llm-benchmark are comparing it to the libraries listed below
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆970Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,879Updated this week
- System 2 Reasoning Link Collection☆722Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,147Updated last week
- Automatically evaluate your LLMs in Google Colab☆575Updated 8 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆704Updated last year
- Minimalistic large language model 3D-parallelism training☆1,386Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆841Updated last week
- A library for making RepE control vectors☆528Updated last week
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆752Updated this week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,992Updated last month
- ☆446Updated 9 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆298Updated 3 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆831Updated last month
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,358Updated 9 months ago
- ☆2,180Updated last week
- Guide for fine-tuning Llama/Mistral/CodeLlama models and more☆555Updated 4 months ago
- ☆664Updated this week
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,580Updated 6 months ago
- ☆484Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,654Updated 5 months ago
- ReFT: Representation Finetuning for Language Models☆1,373Updated 2 weeks ago
- Code for Quiet-STaR☆698Updated 4 months ago
- Generate textbook-quality synthetic LLM pretraining data☆492Updated last year
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆946Updated last week
- Inspect: A framework for large language model evaluations☆716Updated this week
- ☆493Updated 4 months ago