Alternatives and similar repositories for Custom-ConvLayers-Pytorch

Users that are interested in Custom-ConvLayers-Pytorch are comparing it to the libraries listed below

• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆96Updated 2 years ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆86Updated 3 years ago
• maragraziani / concept_discovery_svd
  Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantic…
  ☆14Updated last year
• jfpuget / ARC-AGI-Challenge-2024
  ☆56Updated 11 months ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• augustwester / transformer-xl
  A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
  ☆37Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆44Updated 9 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆110Updated this week
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆60Updated last year
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 3 months ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• epfml / DenseFormer
  ☆81Updated last year
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 10 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆32Updated 5 months ago
• BlackHC / neural_net_checklist
  ☆150Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• jiaweizzhao / ZerO-initialization
  ☆75Updated 2 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆84Updated last year
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆39Updated last year
• cloneofsimo / min-fsdp
  ☆91Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆19Updated last year
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆47Updated last week