ConsequentAI / fneval
Functional Benchmarks and the Reasoning Gap
☆84Updated 6 months ago
Alternatives and similar repositories for fneval:
Users that are interested in fneval are comparing it to the libraries listed below
- Repository for the paper Stream of Search: Learning to Search in Language☆144Updated 2 months ago
- ☆114Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆170Updated 2 months ago
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆86Updated 3 weeks ago
- ☆80Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- ☆32Updated this week
- ☆164Updated last month
- ☆119Updated 6 months ago
- ☆60Updated 11 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆67Updated 9 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆102Updated this week
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆103Updated 4 months ago
- PyTorch library for Active Fine-Tuning☆62Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆167Updated last month
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago
- Code repository for the c-BTM paper☆106Updated last year
- ☆37Updated 2 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated last year
- ☆48Updated 5 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆53Updated 4 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated 2 years ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- Can Language Models Solve Olympiad Programming?☆114Updated 2 months ago
- ☆128Updated last week
- Public Inflection Benchmarks☆68Updated last year