Alternatives and similar repositories for Flax-ResNets

Users that are interested in Flax-ResNets are comparing it to the libraries listed below

• LIONS-EPFL / scion
  ☆49Updated last month
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated 2 years ago
• facebookresearch / Pitfalls-of-Memorization
  Understanding the interplay between memorization and generalization in neural networks, featuring MAT, a learning algorithm to enhance ro…
  ☆40Updated 11 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆81Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• hlml / fortuitous_forgetting
  ☆19Updated 3 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆36Updated 3 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆86Updated last year
• gregorbachmann / scaling_mlps
  ☆52Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆69Updated last year
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆113Updated last month
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆32Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆40Updated 2 years ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆113Updated 11 months ago
• YannDubs / Invariant-Self-Supervised-Learning
  Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"
  ☆41Updated 3 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆80Updated 3 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated last year
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆121Updated last year
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• y0ast / pytorch-snippets
  Collection of snippets for PyTorch users
  ☆25Updated 3 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆36Updated last year
• ahennequ / pytorch-custom-mma
  ☆29Updated 3 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Updated 3 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆101Updated 2 years ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆46Updated 2 years ago