Alternatives and similar repositories for representation-engineering

Users that are interested in representation-engineering are comparing it to the libraries listed below

• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆570Updated last year
• kmeng01 / rome
  Locating and editing factual associations in GPT (NeurIPS 2022)
  ☆724Updated last year
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆903Updated 4 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆535Updated 2 years ago
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆857Updated last week
• openai / sparse_autoencoder
  ☆567Updated last year
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆685Updated last week
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆535Updated last year
• decoderesearch / SAELens
  Training Sparse Autoencoders on Language Models
  ☆1,193Updated this week
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆552Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆567Updated 6 months ago
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆863Updated last year
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆688Updated 2 weeks ago
• jlko / semantic_uncertainty
  Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).
  ☆404Updated last year
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆667Updated last year
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆293Updated 2 years ago
• teacherpeterpan / self-correction-llm-papers
  This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.
  ☆565Updated last year
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆340Updated 7 months ago
• davidbau / baukit
  ☆247Updated last year
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆386Updated 2 years ago
• EdinburghNLP / awesome-hallucination-detection
  List of papers on hallucination detection in LLMs.
  ☆1,041Updated 3 weeks ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆740Updated last year
• sylinrl / TruthfulQA
  TruthfulQA: Measuring How Models Imitate Human Falsehoods
  ☆878Updated last year
• GaryYufei / AlignLLMHumanSurvey
  Aligning Large Language Models with Human: A Survey
  ☆742Updated 2 years ago
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,231Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆373Updated 2 years ago
• zjunlp / KnowledgeEditingPapers
  Must-read Papers on Knowledge Editing for Large Language Models.
  ☆1,212Updated 6 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆598Updated last year
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆767Updated 2 years ago
• vec2text / vec2text
  utilities for decoding deep representations (like sentence embeddings) back to text
  ☆1,058Updated last month