Alternatives and similar repositories for llm-idiosyncrasies

Users that are interested in llm-idiosyncrasies are comparing it to the libraries listed below

• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆90Updated 8 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆102Updated 3 weeks ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• JoshEngels / SAE-Dark-Matter
  Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
  ☆22Updated 5 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆79Updated 8 months ago
• shauli-ravfogel / rlace-icml
  ☆36Updated 3 years ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆69Updated last year
• poloclub / llm-landscape
  NeurIPS'24 - LLM Safety Landscape
  ☆25Updated 4 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆86Updated last year
• JoshEngels / SAE-Probes
  Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"
  ☆26Updated 3 months ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 6 months ago
• shauli-ravfogel / adv-kernel-removal
  ☆12Updated 2 years ago
• felixbinder / introspection_self_prediction
  Code for experiments on self-prediction as a way to measure introspection in LLMs
  ☆15Updated 7 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 6 months ago
• fangyuan-ksgk / CoT-Reasoning-without-Prompting
  Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting
  ☆32Updated last year
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• mcleish7 / gemstone-scaling-laws
  ☆27Updated 5 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆38Updated 8 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆27Updated 4 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆89Updated last year
• model-similarity / lm-similarity
  ☆18Updated 5 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆91Updated 2 months ago
• sfeucht / footprints
  https://footprints.baulab.info
  ☆17Updated 9 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆27Updated last month
• LukeBailey181 / obfuscated-activations
  Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses
  ☆21Updated 5 months ago
• allenai / super-benchmark
  ☆45Updated 3 months ago
• milesaturpin / cot-unfaithfulness
  ☆46Updated last year
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 11 months ago
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆83Updated last month