devvrit / SONew

Related projects ⓘ

Alternatives and complementary repositories for SONew

• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 11 months ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆16Updated 8 months ago
• CLAIRE-Labo / StructuredFFN
  The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
  ☆14Updated 3 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆13Updated this week
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆78Updated 9 months ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆21Updated 4 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• IamHuijben / gumbel_softmax_sampling
  ☆11Updated 2 years ago
• GallagherCommaJack / modulax
  ☆16Updated 2 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated 2 weeks ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆19Updated last year
• google-deepmind / spectral_ssm
  ☆27Updated 6 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• radarFudan / mamba-minimal-jax
  ☆29Updated last month
• HazyResearch / prefix-linear-attention
  ☆44Updated 4 months ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated 10 months ago
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆60Updated 2 years ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 2 years ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆40Updated 2 years ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week
• remilepriol / causal-adaptation-speed
  Investigate the speed of adaptation of structural causal models
  ☆16Updated 3 years ago
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• choidami / sst
  ☆49Updated 4 years ago
• srush / mamba-primer
  ☆35Updated 7 months ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated last year