benlipkin / probsem
Probabilistic LLM evaluations. [CogSci2023; ACL2023]
☆73Updated 8 months ago
Alternatives and similar repositories for probsem:
Users that are interested in probsem are comparing it to the libraries listed below
- ☆44Updated 5 months ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated 2 years ago
- Mechanistic Interpretability for Transformer Models☆50Updated 2 years ago
- Code repository for the c-BTM paper☆106Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆43Updated last year
- ☆93Updated 4 months ago
- ☆90Updated 2 months ago
- Experiments with generating opensource language model assistants☆97Updated last year
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆47Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 4 months ago
- ☆34Updated last year
- ☆38Updated last year
- ☆48Updated last year
- Factored Cognition Primer: How to write compositional language model programs☆48Updated 2 years ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆114Updated 7 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆115Updated last year
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆207Updated 3 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆74Updated last year
- ☆75Updated last month
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- Repository for the paper Stream of Search: Learning to Search in Language☆145Updated 2 months ago
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆30Updated 10 months ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- A repository for transformer critique learning and generation☆90Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- Experiments for efforts to train a new and improved t5☆77Updated last year
- ☆93Updated 11 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated last week