NextWordDev / psychoevalsLinks
Repository for PsychoEvals - a framework for LLM security, psychoanalysis, and moderation.
☆17Updated 2 years ago
Alternatives and similar repositories for psychoevals
Users that are interested in psychoevals are comparing it to the libraries listed below
Sorting:
- Incremental Python parser for constrained generation of code by LLMs.☆18Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆126Updated 2 years ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆437Updated last year
- Plurals: A System for Guiding LLMs Via Simulated Social Ensembles☆28Updated last week
- Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023☆251Updated last year
- Awesome deliberative prompting: How to ask LLMs to produce reliable reasoning and make reason-responsive decisions.☆120Updated 9 months ago
- autoredteam: code for training models that automatically red team other language models☆13Updated 2 years ago
- Large Language Models Meet NL2Code: A Survey☆35Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆230Updated last year
- repo for the paper titled “CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation”☆14Updated 2 years ago
- Evaluating the Moral Beliefs Encoded in LLMs☆31Updated 11 months ago
- Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions☆48Updated 2 months ago
- Can AI-Generated Text be Reliably Detected?☆86Updated 2 years ago
- Continuously updated list of related resources for generative LLMs like GPT and their analysis and detection.☆228Updated 6 months ago
- The repository contains the code and dataset for the Socratic Debugging task which is a novel task for Socratically Questioning Novice De…☆19Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆99Updated 2 years ago
- Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"☆48Updated 2 weeks ago
- Ghostbuster: Detecting Text Ghostwritten by Large Language Models (NAACL 2024)☆168Updated last year
- [EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code☆80Updated last year
- ☆52Updated 8 months ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆193Updated 7 months ago
- ☆41Updated last year
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆172Updated last year
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆107Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆112Updated 5 months ago
- ☆313Updated last year
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆24Updated last year
- Analyzing and scoring reasoning traces of LLMs☆47Updated last year
- A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)☆94Updated last month
- Code for "The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction an…☆11Updated last year