haizelabs / thorn-in-haizestack
Thorn in a HaizeStack test for evaluating long-context adversarial robustness.
☆26Updated 7 months ago
Alternatives and similar repositories for thorn-in-haizestack:
Users that are interested in thorn-in-haizestack are comparing it to the libraries listed below
- Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.☆50Updated last week
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆52Updated 3 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 4 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆85Updated this week
- Sphynx Hallucination Induction☆53Updated last month
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated 10 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆22Updated 2 months ago
- ☆20Updated 4 months ago
- ☆60Updated 10 months ago
- Lego for GRPO☆25Updated last week
- ☆48Updated 4 months ago
- Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…☆10Updated last month
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆67Updated 9 months ago
- LLMs as Collaboratively Edited Knowledge Bases☆45Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated this week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆165Updated 2 weeks ago
- Experiments for efforts to train a new and improved t5☆77Updated 11 months ago
- ☆89Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated 2 weeks ago
- ☆124Updated this week
- ☆26Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated last month
- ☆50Updated 5 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆62Updated last week
- ☆80Updated 2 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆83Updated this week
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆31Updated 3 weeks ago
- Repository for the paper Stream of Search: Learning to Search in Language☆142Updated last month
- utilities for loading and running text embeddings with onnx☆44Updated 7 months ago