Alternatives and similar repositories for llm-idiosyncrasies

Users that are interested in llm-idiosyncrasies are comparing it to the libraries listed below

• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆161Updated 6 months ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆70Updated last year
• LivingFutureLab / DeltaBench
  ☆45Updated 10 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆94Updated last year
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆85Updated last year
• technion-cs-nlp / LLMsKnow
  ☆86Updated 11 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆41Updated last year
• Luckfort / CD
  [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
  ☆82Updated 11 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆132Updated last year
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆213Updated 11 months ago
• hkust-nlp / Toolathlon
  The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution
  ☆204Updated this week
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆147Updated last year
• neulab / gemini-benchmark
  ☆150Updated 2 years ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆162Updated last month
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆35Updated 10 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆73Updated 8 months ago
• fangyuan-ksgk / CoT-Reasoning-without-Prompting
  Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting
  ☆34Updated last year
• collinzrj / output2prompt
  ☆54Updated 9 months ago
• clinicalml / co-llm
  Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
  ☆123Updated last year
• sail-sg / Rigging-ChatbotArena
  Improving Your Model Ranking on Chatbot Arena by Vote Rigging (ICML 2025)
  ☆26Updated 10 months ago
• JIA-Lab-research / MR-GSM8K
  Challenge LLMs to Reason About Reasoning: A Benchmark to Unveil Cognitive Depth in LLMs
  ☆50Updated last year
• MadryLab / DsDm
  ☆51Updated last year
• sail-sg / Agent-Smith
  [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  ☆117Updated last year
• JoshEngels / SAE-Probes
  Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"
  ☆31Updated 9 months ago
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆48Updated last year
• stanford-crfm / air-bench-2024
  AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies
  ☆28Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• PRIME-RL / RL-Compositionality
  FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones
  ☆55Updated 2 months ago
• google-deepmind / bbeh
  ☆110Updated 8 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆53Updated 10 months ago