Alternatives and similar repositories for perplexity-correlations:

Users that are interested in perplexity-correlations are comparing it to the libraries listed below

• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆25Updated last year
• PAIR-code / pretraining-tda
  ☆16Updated 2 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆39Updated last month
• r-three / mats
  ☆30Updated 9 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆11Updated 2 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• mcleish7 / gemstone-scaling-laws
  ☆23Updated 2 months ago
• mmatena / model_merging
  ☆66Updated 3 years ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 11 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆70Updated 3 weeks ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆62Updated 2 months ago
• KihoPark / linear_rep_geometry
  ☆91Updated 2 months ago
• milesaturpin / cot-unfaithfulness
  ☆41Updated last year
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆48Updated 5 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆45Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆88Updated last year
• MadryLab / DsDm
  ☆47Updated last year
• hadasah / btm
  ☆72Updated 11 months ago
• berlino / seq_icl
  ☆51Updated 11 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• guy-dar / embedding-space
  ☆54Updated last year
• EleutherAI / w2s
  ☆23Updated 7 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆22Updated 10 months ago
• angie-chen55 / pref-learning-ranking-acc
  ☆12Updated 10 months ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆75Updated last year
• roeehendel / icl_task_vectors
  ☆93Updated last year