Alternatives and similar repositories for ICL_Modular_Arithmetic:

Users that are interested in ICL_Modular_Arithmetic are comparing it to the libraries listed below

• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆31Updated 3 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated 7 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated last year
• jiahai-feng / binding-iclr
  ☆13Updated last year
• sjelassi / transformers_ssm_copy
  ☆31Updated last year
• uservan / ThinkPO
  ☆20Updated last month
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆37Updated last month
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆29Updated 3 weeks ago
• mandyyyyii / east
  ☆15Updated last week
• mcleish7 / gemstone-scaling-laws
  ☆22Updated 2 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆35Updated 5 months ago
• IdoAmos / not-from-scratch
  ☆31Updated 5 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆22Updated last year
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆20Updated 11 months ago
• wenzhe-li / Self-MoA
  ☆18Updated 2 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆21Updated 4 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆50Updated last month
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆16Updated 5 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆25Updated 5 months ago
• Silent-Zebra / twisted-smc-lm
  ☆28Updated 3 weeks ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆23Updated last month
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆44Updated last month
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆54Updated 10 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 2 months ago
• justinlovelace / Diffusion-Guided-LM
  ☆26Updated 8 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆50Updated 3 weeks ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆10Updated 2 weeks ago
• allenbai01 / transformers-as-statisticians
  ☆31Updated last year