Alternatives and similar repositories for Custom-ConvLayers-Pytorch

Users that are interested in Custom-ConvLayers-Pytorch are comparing it to the libraries listed below

• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• jfpuget / ARC-AGI-Challenge-2024
  ☆56Updated last year
• teddykoker / tinyloader
  ☆68Updated 10 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Updated 3 years ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆32Updated 8 months ago
• clemkoa / ntm
  Neural Turing Machines in pytorch
  ☆49Updated 4 years ago
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• srush / Tensor-Puzzles-Penzai
  ☆22Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 3 years ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆113Updated 3 months ago
• ayulockin / LossLandscape
  Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …
  ☆66Updated 5 years ago
• augustwester / transformer-xl
  A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
  ☆37Updated 3 years ago
• srush / mamba-primer
  ☆39Updated last year
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆72Updated 3 weeks ago
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆48Updated 6 months ago
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆57Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated last year
• epfml / DenseFormer
  ☆82Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• radarFudan / mamba-minimal-jax
  ☆35Updated last year
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated last year
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago