Alternatives and similar repositories for algorithmic-creativity

Users that are interested in algorithmic-creativity are comparing it to the libraries listed below

• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆186Updated last week
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆105Updated 2 weeks ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆57Updated 8 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 6 months ago
• RobertCsordas / moeut
  ☆87Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆132Updated last week
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆46Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆131Updated 2 weeks ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆85Updated last year
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆55Updated 11 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆63Updated last month
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆149Updated this week
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated 10 months ago
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆49Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆84Updated 9 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆31Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆99Updated last year
• complex-reasoning / RPG
  Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆54Updated 3 weeks ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆106Updated last year
• CLAIRE-Labo / EvoTune
  Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
  ☆118Updated 3 weeks ago
• yilundu / ired_code_release
  ☆73Updated last year
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆85Updated 2 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆121Updated 2 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆57Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆116Updated last year
• OpenMOSS / LongLLaDA
  LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
  ☆43Updated 3 months ago
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆101Updated last month