Alternatives and similar repositories for entropix:

Users that are interested in entropix are comparing it to the libraries listed below

• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated this week
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 2 weeks ago
• sayakpaul / EvoNorms-in-TensorFlow-2
  Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.
  ☆11Updated 4 years ago
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆15Updated 3 years ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated last year
• RandallBalestriero / SplineLLM
  ☆15Updated last year
• shoaibahmed / metadata_archaeology
  Official code for the paper: "Metadata Archaeology"
  ☆19Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆32Updated 3 months ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆20Updated 2 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• SamsungSAILMontreal / PAPA
  Repository for the PopulAtion Parameter Averaging (PAPA) paper
  ☆26Updated 10 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆14Updated this week
• stanford-crfm / helm-efficiency
  ☆9Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆14Updated 2 weeks ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 2 months ago
• simran-arora / focus
  This repo contains code for the paper: "Can Foundation Models Help Us Achieve Perfect Secrecy?"
  ☆24Updated 2 years ago
• yizhangzzz / transformers-lego
  ☆18Updated 2 years ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• EleutherAI / training-jacobian
  ☆20Updated 2 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆37Updated 2 months ago
• realityengines / post_hoc_debiasing
  ☆17Updated 4 years ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆20Updated 3 weeks ago
• ctlllll / reward_collapse
  ☆26Updated last year
• sjunhongshen / DASH
  ☆21Updated 2 years ago