Alternatives and similar repositories for ICon

Users that are interested in ICon are comparing it to the libraries listed below

• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 7 months ago
• CLAIRE-Labo / EvoTune
  Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
  ☆100Updated last month
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆139Updated 2 weeks ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆126Updated 9 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆100Updated 5 months ago
• LLM360 / k2-train
  ☆50Updated last year
• Think-a-Tron / evolve
  open source alpha evolve
  ☆62Updated 2 weeks ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆182Updated 4 months ago
• mlbio-epfl / joint-inference
  [ICLR 2025] Large (Vision) Language Models are Unsupervised In-Context Learners
  ☆12Updated 2 months ago
• PolymathicAI / xVal
  Repository for code used in the xVal paper
  ☆134Updated last year
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆51Updated this week
• tae898 / vae-diffusion
  ☆26Updated this week
• ml-jku / hopfield-boosting
  ☆31Updated last year
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆187Updated 2 months ago
• NVlabs / hymba
  ☆178Updated 5 months ago
• apple / ml-sigmoid-attention
  ☆286Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• zaydzuhri / softpick-attention
  Implementations of attention with the softpick function, naive and FlashAttention-2
  ☆76Updated last month
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆95Updated 4 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆61Updated 3 weeks ago
• epfml / DenseFormer
  ☆80Updated last year
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆237Updated 2 months ago
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆125Updated this week
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆119Updated last year
• LitLLM / litllms-for-literature-review-tmlr
  Code for LitLLMs, LLMs for Literature Review: Are we there yet? (TMLR 2025)
  ☆29Updated last month
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆128Updated 3 weeks ago
• FusionBrainLab / LLM-Microscope
  ☆71Updated 9 months ago
• neilwen987 / CSR_Adaptive_Rep
  Official Code for Paper: Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation
  ☆67Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆65Updated 9 months ago