A curated list of awesome resources for Artificial Intelligence Alignment research
☆82Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for awesome-ai-alignment
Users that are interested in awesome-ai-alignment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Machine Learning for Alignment Bootcamp☆87Apr 27, 2022Updated 4 years ago
- Models for data stocks and training dataset sizes☆21Jul 10, 2024Updated 2 years ago
- ☆14Mar 31, 2024Updated 2 years ago
- ☆15Aug 9, 2023Updated 3 years ago
- (Model-written) LLM evals library☆19Dec 13, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Machine Learning for Alignment Bootcamp☆28Mar 7, 2024Updated 2 years ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆23Nov 15, 2023Updated 2 years ago
- Code for our paper "Localizing Lying in Llama"☆15Apr 24, 2025Updated last year
- list of projects related to EA Software Engineers☆28Jun 23, 2023Updated 3 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- Methods 2: The General Linear Model☆15May 5, 2022Updated 4 years ago
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆19Jul 6, 2026Updated 2 months ago
- Meta-repo for the Nowcasting project.☆11Oct 15, 2024Updated last year
- Repo for the paper on Escalation Risks of AI systems☆45Apr 12, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Nov 28, 2022Updated 3 years ago
- Code repo for the model organisms and convergent directions of EM papers.☆86Sep 22, 2025Updated last year
- we got you bro☆39Jul 29, 2024Updated 2 years ago
- Machine Learning for Alignment Bootcamp (MLAB).☆36Jan 24, 2022Updated 4 years ago
- ☆81May 31, 2023Updated 3 years ago
- A Mechanistic Interpretability Analysis of Grokking☆29Sep 26, 2022Updated 4 years ago
- Obsidian To HTML, A template for building obsidian style notes to a static site☆19Nov 3, 2022Updated 3 years ago
- Multiplayer JS game platform☆16Oct 16, 2017Updated 8 years ago
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Aug 21, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🔥 A repository for collecting cyberdefense thoughts, books, and documents about AI cyberdefense☆13Jul 2, 2023Updated 3 years ago
- ☆22Jan 7, 2025Updated last year
- lanmt ebm☆12Jun 19, 2020Updated 6 years ago
- ☆22Dec 29, 2025Updated 8 months ago
- 🧠 Inspecting complexity and goal-directedness of imagination in an fNIRS BCI system.☆11Aug 26, 2023Updated 3 years ago
- A Quasi-Wasserstein Loss for Learning Graph Neural Networks (QW loss)☆10May 20, 2024Updated 2 years ago
- prompt library for calculus resources☆16Sep 1, 2023Updated 3 years ago
- 📚📚📚📚📚📚📚📚📚 Reading everything☆17Mar 11, 2026Updated 6 months ago
- Curated Collection of Online and Free Resources for serious learning of Machine Learning and Data Science.☆35Feb 11, 2021Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Benchmarking Dark Patterns in LLMs (ICLR 2025)☆19Mar 29, 2025Updated last year
- A toolbox with the goal of speeding up research on bargaining in MARL (cooperation problems in MARL).☆33Sep 29, 2022Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- ☆50Oct 24, 2023Updated 2 years ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,857Jun 17, 2025Updated last year
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- Official repo for the paper "Make Some Noise: Reliable and Efficient Single-Step Adversarial Training" (https://arxiv.org/abs/2202.01181)☆25Oct 17, 2022Updated 3 years ago