Leiay / looped_transformer

Related projects ⓘ

Alternatives and complementary repositories for looped_transformer

• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 5 months ago
• IdoAmos / not-from-scratch
  ☆26Updated last month
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• berlino / seq_icl
  ☆50Updated 6 months ago
• activatedgeek / calibration-tuning
  ☆36Updated 3 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• formll / resolving-scaling-law-discrepancies
  ☆15Updated 4 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• KihoPark / linear_rep_geometry
  ☆76Updated 9 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆39Updated 3 months ago
• RobertCsordas / moeut
  ☆62Updated 3 months ago
• epfml / llm-baselines
  NanoGPT-like codebase for LLM training
  ☆75Updated this week
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆61Updated last week
• radarFudan / mamba-minimal-jax
  ☆29Updated this week
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆22Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆17Updated 3 weeks ago
• wang-kee / LiNeS
  ☆22Updated 2 weeks ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆13Updated this week
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆94Updated 7 months ago
• jacobdunefsky / transcoder_circuits
  ☆44Updated this week
• r-three / mats
  ☆25Updated 4 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆84Updated 8 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆19Updated last month
• EleutherAI / w2s
  ☆18Updated last month
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆48Updated 7 months ago