jnward / monosemanticity-repro

Related projects ⓘ

Alternatives and complementary repositories for monosemanticity-repro

• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆93Updated this week
• google-deepmind / mishax
  ☆100Updated 3 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆177Updated 5 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆160Updated last month
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 2 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆143Updated 3 weeks ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆201Updated 6 months ago
• HammingHQ / bug-in-the-code-stack
  A new benchmark for measuring LLM's capability to detect bugs in large codebase.
  ☆27Updated 5 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆114Updated 3 months ago
• yueqis / API-Based-Agent
  ☆31Updated 2 weeks ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated 6 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated 10 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆118Updated last month
• EleutherAI / sae-auto-interp
  ☆105Updated this week
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated 9 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆78Updated last month
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆158Updated this week
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆105Updated 2 weeks ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆84Updated 7 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆102Updated last month
• joshuacnf / Ctrl-G
  ☆74Updated 2 weeks ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆62Updated this week
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆60Updated last month
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆74Updated this week
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆84Updated 3 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆64Updated last month
• cognitivecomputations / spectrum
  ☆92Updated last month
• teknium1 / transformers-gptq-quant
  ☆48Updated last year