tysam-code / hlb-CIFAR10

Related projects ⓘ

Alternatives and complementary repositories for hlb-CIFAR10

• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,296Updated 5 months ago
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,402Updated 4 months ago
• xl0 / lovely-tensors
  Tensors, for human consumption
  ☆1,113Updated 3 weeks ago
• google / learned_optimization
  ☆751Updated this week
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆1,898Updated 2 weeks ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• mpezeshki / pytorch_forward_forward
  Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
  ☆1,447Updated last year
• lucidrains / lion-pytorch
  🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
  ☆2,041Updated 5 months ago
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆869Updated 5 months ago
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆970Updated 3 months ago
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆866Updated 7 months ago
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,079Updated last year
• Liuhong99 / Sophia
  The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
  ☆939Updated 9 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,135Updated this week
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆449Updated this week
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆513Updated last year
• libffcv / ffcv
  FFCV: Fast Forward Computer Vision (and other ML workloads!)
  ☆2,867Updated 5 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆325Updated last year
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆333Updated 3 weeks ago
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆840Updated this week
• tanelp / tiny-diffusion
  A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.
  ☆663Updated 6 months ago
• samuela / git-re-basin
  Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"
  ☆471Updated last year
• google-deepmind / penzai
  A JAX research toolkit for building, editing, and visualizing neural networks.
  ☆1,679Updated this week
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆604Updated 9 months ago
• srush / Autodiff-Puzzles
  ☆391Updated last month
• google-deepmind / xmanager
  A platform for managing machine learning experiments
  ☆818Updated 3 months ago
• google / ml_collections
  ML Collections is a library of Python Collections designed for ML use cases.
  ☆896Updated this week
• n2cholas / awesome-jax
  JAX - A curated list of resources https://github.com/google/jax
  ☆1,562Updated 4 months ago
• google-deepmind / tracr
  ☆508Updated 9 months ago