Alternatives and similar repositories for arxiv-sanity-lite:

Users that are interested in arxiv-sanity-lite are comparing it to the libraries listed below

• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,324Updated 9 months ago
• xl0 / lovely-tensors
  Tensors, for human consumption
  ☆1,202Updated 4 months ago
• patrick-kidger / torchtyping
  Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.
  ☆1,420Updated 7 months ago
• libffcv / ffcv
  FFCV: Fast Forward Computer Vision (and other ML workloads!)
  ☆2,906Updated 9 months ago
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,480Updated 8 months ago
• google / ml_collections
  ML Collections is a library of Python Collections designed for ML use cases.
  ☆928Updated last month
• google-deepmind / tracr
  ☆525Updated last year
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,090Updated last year
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,016Updated last year
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆627Updated last year
• facebookincubator / submitit
  Python 3.8+ toolbox for submitting jobs to Slurm
  ☆1,397Updated 6 months ago
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆884Updated 11 months ago
• google-deepmind / penzai
  A JAX research toolkit for building, editing, and visualizing neural networks.
  ☆1,746Updated 3 months ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,414Updated this week
• patrick-kidger / jaxtyping
  Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/
  ☆1,348Updated this week
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆435Updated 6 months ago
• webdataset / webdataset
  A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
  ☆2,502Updated last month
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,508Updated 4 months ago
• tysam-code / hlb-CIFAR10
  Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)
  ☆1,252Updated 3 months ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,278Updated 2 months ago
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,037Updated 11 months ago
• google / BIG-bench
  Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
  ☆2,997Updated 8 months ago
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆999Updated 7 months ago
• google-deepmind / dm-haiku
  JAX-based neural network library
  ☆2,990Updated last week
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆333Updated last year
• srush / Autodiff-Puzzles
  ☆423Updated 5 months ago
• ELS-RD / kernl
  Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…
  ☆1,559Updated last year
• google / learned_optimization
  ☆771Updated 2 months ago
• google / fiddle
  ☆345Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆948Updated 2 weeks ago