Alternatives and similar repositories for representation-engineering

Users that are interested in representation-engineering are comparing it to the libraries listed below

• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆556Updated 9 months ago
• kmeng01 / rome
  Locating and editing factual associations in GPT (NeurIPS 2022)
  ☆693Updated last year
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆893Updated last month
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆530Updated last year
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆828Updated last month
• openai / sparse_autoencoder
  ☆543Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆546Updated 3 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆656Updated 5 months ago
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆526Updated last year
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆523Updated 10 months ago
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆663Updated this week
• decoderesearch / SAELens
  Training Sparse Autoencoders on Language Models
  ☆1,060Updated this week
• EdinburghNLP / awesome-hallucination-detection
  List of papers on hallucination detection in LLMs.
  ☆987Updated last week
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆382Updated last year
• zjunlp / KnowledgeEditingPapers
  Must-read Papers on Knowledge Editing for Large Language Models.
  ☆1,197Updated 4 months ago
• davidbau / baukit
  ☆237Updated last year
• jlko / semantic_uncertainty
  Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).
  ☆387Updated last year
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆299Updated 5 months ago
• teacherpeterpan / self-correction-llm-papers
  This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.
  ☆557Updated last year
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆859Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆551Updated last year
• jxzhangjhu / Awesome-LLM-Uncertainty-Reliability-Robustness
  Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models
  ☆790Updated 6 months ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆283Updated 2 years ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆658Updated last year
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆576Updated last year
• cooperleong00 / Awesome-LLM-Interpretability
  A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..
  ☆284Updated 8 months ago
• suzgunmirac / BIG-Bench-Hard
  Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
  ☆529Updated last year
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆768Updated 2 years ago
• madaan / self-refine
  LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.
  ☆757Updated last year
• zjunlp / Prompt4ReasoningPapers
  [ACL 2023] Reasoning with Language Model Prompting: A Survey
  ☆985Updated 6 months ago