McGill-NLP / safearenaLinks
SafeArena is a benchmark for assessing the harmful capabilities of web agents
☆15Updated 2 months ago
Alternatives and similar repositories for safearena
Users that are interested in safearena are comparing it to the libraries listed below
Sorting:
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆60Updated 7 months ago
- ☆51Updated last year
- ☆29Updated last year
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆69Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆25Updated 3 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated 3 months ago
- ☆95Updated last year
- Materials for EACL2024 tutorial: Transformer-specific Interpretability☆55Updated last year
- DecompX: Explaining Transformers Decisions by Propagating Token Decomposition [ACL 2023]☆18Updated last year
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆37Updated 10 months ago
- General-purpose activation steering library☆78Updated last month
- ☆27Updated last year
- LLM finetuning in resource-constrained environments.☆47Updated last year
- ☆18Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆81Updated last year
- FeedbackQA: Improving Question Answering Post-Deployment with Interactive Feedback☆12Updated 2 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆116Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆170Updated 2 months ago
- Data and code for the paper "NormBank: A Knowledge Bank of Situational Social Norms"☆28Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆24Updated 3 months ago
- ☆51Updated 2 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆112Updated 9 months ago
- Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)☆30Updated last month
- ☆164Updated 7 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆77Updated 6 months ago
- ☆44Updated 10 months ago
- [arXiv] EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees☆21Updated 3 months ago
- AI Logging for Interpretability and Explainability🔬☆123Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆78Updated last year
- AbstainQA, ACL 2024☆26Updated 8 months ago