Alternatives and similar repositories for online-normalization

Users that are interested in online-normalization are comparing it to the libraries listed below

• Separius / CudaRelativeAttention
  custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
  ☆43Updated 5 years ago
• jongwook / tfrecord_lite
  Make TFRecord Usable Again
  ☆90Updated 2 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 5 years ago
• L0SG / NanoFlow
  PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)
  ☆66Updated 5 years ago
• renqianluo / GBDT-NAS
  GBDT-NAS
  ☆28Updated 4 years ago
• naturomics / DLF
  Code for reproducing results in "Generative Model with Dynamic Linear Flow"
  ☆70Updated 6 years ago
• pseeth / autoclip
  Adaptive Gradient Clipping
  ☆153Updated 3 years ago
• ag14774 / diffdist
  ☆62Updated 5 years ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• speechmatics / hqa
  Code to accompany the paper "Hierarchical Quantized Autoencoders"
  ☆37Updated 2 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 6 years ago
• gcambara / cape
  Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
  ☆42Updated 3 years ago
• angelajiang / SelectiveBackprop
  SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss
  ☆32Updated 5 years ago
• NVlabs / webloader
  Efficient DataLoader for PyTorch and Keras for loading datasets from web servers and object stores.
  ☆30Updated 6 years ago
• SarthakYadav / audax
  A home for audio ML in JAX. Has common features, learnable frontends, pretrained supervised and self-supervised models.
  ☆69Updated 3 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 5 years ago
• facebookresearch / gtn_applications
  Applications using the GTN library and code to reproduce experiments in "Differentiable Weighted Finite-State Transducers"
  ☆83Updated 3 years ago
• Newbeeer / Anytime-Auto-Regressive-Model
  Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"
  ☆26Updated 2 years ago
• NVlabs / tensorcom
  ☆107Updated 4 years ago
• tmbdev-archive / webdataset-lightning
  A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
  ☆76Updated 2 years ago
• tmbdev-archive / webdataset-examples
  Examples for the WebDataset PyTorch Dataset Library
  ☆51Updated 4 years ago
• vinbhaskara / AdamS
  PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]
  ☆15Updated last month
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆237Updated 2 years ago
• YuchenJin / autolrs
  Automatic learning-rate scheduler
  ☆46Updated 4 years ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆71Updated 3 years ago
• ClashLuke / PerfTorch
  High performance pytorch modules
  ☆18Updated 3 years ago
• AlbertOh90 / Soft-VQ-VAE
  ☆20Updated 6 years ago
• distsup / DistSup
  Representation learning for NLP @ JSALT19
  ☆40Updated 5 years ago