A curated list of awesome resources for Artificial Intelligence Alignment research
☆84Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for awesome-ai-alignment
Users that are interested in awesome-ai-alignment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Obsidian starter kit for LessWrong, Effective Altruism, AI Alignment, etc.☆15Nov 12, 2022Updated 3 years ago
- Machine Learning for Alignment Bootcamp☆88Oct 6, 2026Updated last month
- Interpretability dashboard for reinforcement learners☆16Jun 4, 2019Updated 7 years ago
- Python tools☆14Oct 22, 2023Updated 3 years ago
- Website for PauseAI.info☆29Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆14Mar 31, 2024Updated 2 years ago
- ☆15Aug 9, 2023Updated 3 years ago
- Explore, Establish, Exploit: Red Teaming Language Models from Scratch☆15Jun 21, 2023Updated 3 years ago
- Formal Contracts for Multi-Agent Reinforcement Learning☆20Oct 24, 2023Updated 3 years ago
- Models for data stocks and training dataset sizes☆22Jul 10, 2024Updated 2 years ago
- This is the implementation for IEEE S&P 2022 paper "Model Orthogonalization: Class Distance Hardening in Neural Networks for Better Secur…☆11Aug 24, 2022Updated 4 years ago
- (Model-written) LLM evals library☆19Dec 13, 2024Updated last year
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- Unofficial and Partial Implementation of Fast AutoAugment in Pytorch☆10Oct 3, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for our paper "Localizing Lying in Llama"☆15Apr 24, 2025Updated last year
- list of projects related to EA Software Engineers☆28Jun 23, 2023Updated 3 years ago
- Official implementation of (CVPR 2022 Oral) Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks.☆27Jul 3, 2025Updated last year
- Methods 2: The General Linear Model☆14May 5, 2022Updated 4 years ago
- Comparing sequential forecasters via confidence sequences & e-processes☆11Oct 24, 2023Updated 3 years ago
- ☆15May 11, 2019Updated 7 years ago
- ☆13Oct 21, 2021Updated 5 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated 2 years ago
- [Findings of EMNLP 2022] Expose Backdoors on the Way: A Feature-Based Efficient Defense against Textual Backdoor Attacks☆13Feb 26, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆19Jul 6, 2026Updated 4 months ago
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆71Jun 9, 2025Updated last year
- A Javascript library to parse ISO Base Media File Format (MPEG-4 Part 12)☆11Mar 2, 2026Updated 8 months ago
- Examples using the Leap Interpretability Engine!☆10Dec 22, 2023Updated 2 years ago
- ☆22Sep 9, 2021Updated 5 years ago
- ☆11Feb 2, 2026Updated 9 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated last year
- SafeLife: safety benchmarks for reinforcement learning agents☆61May 13, 2021Updated 5 years ago
- Code for the paper "Pretrained Models for Multilingual Federated Learning" at NAACL 2022☆11Aug 9, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆82May 31, 2023Updated 3 years ago
- ☆37May 28, 2023Updated 3 years ago
- Multiplayer JS game platform☆16Oct 16, 2017Updated 9 years ago
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Aug 21, 2023Updated 3 years ago
- Dynamic Clifford+T surface code compiler☆19Updated this week
- Code repo for the model organisms and convergent directions of EM papers.☆90Sep 22, 2025Updated last year
- The Obfuscation Atlas: Mapping Where Honesty Emerges in RLVR with Deception Probes☆20Oct 3, 2026Updated last month