Alternatives and similar repositories for llm-benchmarks

Users that are interested in llm-benchmarks are comparing it to the libraries listed below

• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• mishajw / repeng
  Experiments with representation engineering
  ☆11Updated last year
• hijohnnylin / automated-interpretability
  ☆10Updated last month
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• Butanium / nnterp
  A small package implementing some useful wrapping around nnsight
  ☆13Updated this week
• koayon / atp_star
  PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)
  ☆18Updated 5 months ago
• allenai / bff
  ☆38Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 7 months ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• ckkissane / sae-transfer
  Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"
  ☆11Updated 11 months ago
• callummcdougall / sae-exercises-mats
  ☆22Updated last year
• basusourya / mirostat
  Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).
  ☆59Updated 3 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• annahdo / implementing_activation_steering
  A collection of different ways to implement accessing and modifying internal model activations for LLMs
  ☆18Updated 8 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• openfeedback / superhf
  Open-source Human Feedback Library
  ☆11Updated last year
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆28Updated 9 months ago
• nrimsky / InfluenceFunctions
  Implementation of Influence Function approximations for differently sized ML models, using PyTorch
  ☆15Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• Zyphra / Zyda_processing
  ☆35Updated last year
• noanabeshima / tinymodel
  A TinyStories LM with SAEs and transcoders
  ☆11Updated 2 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• hijohnnylin / neuronpedia-scorer
  ☆17Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆101Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆57Updated 2 years ago
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆77Updated 2 years ago
• kaistAI / factual-knowledge-acquisition
  ☆19Updated last month
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆63Updated 2 months ago