egozverev / Should-It-Be-Executed-Or-Processed
Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
☆50Updated last month
Alternatives and similar repositories for Should-It-Be-Executed-Or-Processed:
Users that are interested in Should-It-Be-Executed-Or-Processed are comparing it to the libraries listed below
- Thorn in a HaizeStack test for evaluating long-context adversarial robustness.☆26Updated 8 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆25Updated 3 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆54Updated 4 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆35Updated last week
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆33Updated last month
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated last week
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆63Updated last month
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 5 months ago
- ☆51Updated last week
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 5 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 5 months ago
- The first dense retrieval model that can be prompted like an LM☆71Updated 7 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆68Updated 10 months ago
- ☆48Updated 5 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆84Updated 5 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- ☆50Updated 5 months ago
- ☆56Updated 7 months ago
- Improving Alignment and Robustness with Circuit Breakers☆196Updated 7 months ago
- ☆80Updated 3 months ago
- ☆73Updated last year
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated 10 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆141Updated last year
- ☆20Updated last year
- ReLM is a Regular Expression engine for Language Models☆103Updated last year
- accompany material for sleep time compute paper☆17Updated this week
- ☆38Updated last month