stanford-crfm / air-bench-2024Links
AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies
☆24Updated last year
Alternatives and similar repositories for air-bench-2024
Users that are interested in air-bench-2024 are comparing it to the libraries listed below
Sorting:
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆29Updated 7 months ago
- ☆23Updated 11 months ago
- [EMNLP 2025 Main] ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆35Updated last month
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆82Updated 11 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆39Updated 10 months ago
- NeurIPS'24 - LLM Safety Landscape☆29Updated 7 months ago
- ☆28Updated 4 months ago
- ☆48Updated last year
- ☆30Updated last year
- source code for NeurIPS'24 paper "HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection"☆55Updated 5 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆61Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆31Updated 8 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆97Updated last year
- ☆19Updated 3 months ago
- [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast☆114Updated last year
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆60Updated 11 months ago
- ☆21Updated 3 weeks ago
- ☆33Updated 8 months ago
- ☆31Updated 2 years ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆129Updated 3 months ago
- [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"☆83Updated last year
- [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"☆24Updated 3 months ago
- ☆20Updated last month
- ☆26Updated 6 months ago
- ☆41Updated 11 months ago
- Restore safety in fine-tuned language models through task arithmetic☆28Updated last year
- ☆45Updated 7 months ago
- ☆27Updated last year
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆64Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆64Updated 8 months ago