Alternatives and similar repositories for ARC-AGI-Challenge-2024:

Users that are interested in ARC-AGI-Challenge-2024 are comparing it to the libraries listed below

• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 2 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆79Updated 3 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 2 months ago
• epfml / DenseFormer
  ☆79Updated 11 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• okarthikb / state-space-models
  ☆27Updated 8 months ago
• SHI-Labs / CompactNet
  ☆31Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆87Updated 4 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆32Updated 8 months ago
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆54Updated last month
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆62Updated 7 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 3 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆26Updated 2 weeks ago
• kyleliang919 / Super_Muon
  ☆47Updated this week
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆95Updated 7 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆55Updated 10 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆48Updated this week
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 5 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 8 months ago
• ClashLuke / SOAP
  ☆21Updated 4 months ago
• clement-bonnet / lpn
  Latent Program Network (from the "Searching Latent Program Spaces" paper)
  ☆72Updated 2 weeks ago
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆63Updated last month
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆87Updated 8 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 4 months ago