loeweX / Custom-ConvLayers-PytorchLinks
A reimplementation of 2D Convolutional and Transposed Convolutional Layers in PyTorch, designed for easy modifications and analysis. Includes comprehensive explanations and testing.
☆20Updated last year
Alternatives and similar repositories for Custom-ConvLayers-Pytorch
Users that are interested in Custom-ConvLayers-Pytorch are comparing it to the libraries listed below
Sorting:
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)☆37Updated 2 years ago
- ☆53Updated 9 months ago
- Understanding how features learned by neural networks evolve throughout training☆36Updated 8 months ago
- ☆68Updated 11 months ago
- Jax like function transformation engine but micro, microjax☆33Updated 8 months ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆31Updated last month
- Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)☆56Updated 9 months ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 6 months ago
- Minimum Description Length probing for neural network representations☆18Updated 5 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆31Updated 3 weeks ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- ☆20Updated last year
- Generative cellular automaton-like learning environments for RL.☆19Updated 5 months ago
- Simple repository for training small reasoning models☆33Updated 5 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 2 years ago
- ☆66Updated 3 months ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- QLoRA for Masked Language Modeling☆22Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 9 months ago
- Easily run PyTorch on multiple GPUs & machines☆46Updated 3 weeks ago
- Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"☆34Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆35Updated last year
- Embedding Recycling for Language models☆39Updated 2 years ago
- ☆31Updated 2 years ago
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆18Updated 2 years ago