ethancaballero / broken_neural_scaling_laws

Related projects ⓘ

Alternatives and complementary repositories for broken_neural_scaling_laws

• shikaiqiu / compute-better-spent
  ☆46Updated last month
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• berlino / seq_icl
  ☆50Updated 6 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 5 months ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆49Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆34Updated last year
• epfml / llm-baselines
  NanoGPT-like codebase for LLM training
  ☆75Updated this week
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆34Updated 8 months ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆95Updated last year
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆32Updated last year
• google-deepmind / emergent_in_context_learning
  ☆77Updated 3 months ago
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• gregorbachmann / Next-Token-Failures
  ☆69Updated 8 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆19Updated 8 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆55Updated 9 months ago
• srush / mamba-scans
  Blog post
  ☆16Updated 9 months ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆54Updated 2 years ago
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• guy-dar / embedding-space
  ☆50Updated last year
• AllanYangZhou / universal_neural_functional
  ☆48Updated 9 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆26Updated 11 months ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆30Updated 4 months ago