ExtensityAI / benchmark
Evaluation of neuro-symbolic engines
☆34Updated 7 months ago
Alternatives and similar repositories for benchmark:
Users that are interested in benchmark are comparing it to the libraries listed below
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated 9 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated 11 months ago
- ☆34Updated last year
- ☆34Updated 3 months ago
- Replicating O1 inference-time scaling laws☆83Updated 3 months ago
- Universal Neurons in GPT2 Language Models☆27Updated 9 months ago
- Sparse and discrete interpretability tool for neural networks☆59Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆66Updated 9 months ago
- ☆26Updated 8 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆69Updated 7 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆103Updated 11 months ago
- ☆62Updated last month
- Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs☆34Updated last year
- ☆67Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- ☆26Updated last year
- ☆37Updated 11 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆142Updated last month
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆35Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- ☆60Updated 10 months ago
- Official Implementation of "DeLLMa: Decision Making Under Uncertainty with Large Language Models"☆49Updated 5 months ago
- Minimum Description Length probing for neural network representations☆19Updated last month
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 9 months ago
- Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.☆38Updated last month
- ☆24Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆39Updated 3 months ago
- Understanding how features learned by neural networks evolve throughout training☆33Updated 4 months ago