PAIR-code / tiny-transformers
☆20Updated 2 weeks ago
Alternatives and similar repositories for tiny-transformers
Users that are interested in tiny-transformers are comparing it to the libraries listed below
Sorting:
- Implementation of Metaformer, but in an autoregressive manner☆24Updated 2 years ago
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago
- ☆16Updated last year
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- Understanding RL vision Distill article☆23Updated 2 years ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- ☆18Updated last year
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆28Updated 4 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- Framework for building algorithms based on FractalAI theory☆19Updated 4 years ago
- The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…☆12Updated 3 years ago
- Training hybrid models for dummies.☆21Updated 4 months ago
- ☆31Updated last year
- Low-Rank Adaptation of Large Language Models clean implementation☆8Updated last year
- Automatically generate simple meta-learning tasks from a very large space☆15Updated last year
- ☆11Updated 11 months ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- AdaCat☆49Updated 2 years ago
- A JAX nn library☆21Updated 2 months ago
- Repo to reproduce the First-Explore paper results☆37Updated 4 months ago
- A framework for implementing equivariant DL☆10Updated 3 years ago
- Shows how to do parameter ensembling using differential evolution.☆10Updated 3 years ago
- Explorations into the proposed Streaming Deep Reinforcement Learning, from University of Alberta☆19Updated 6 months ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Personal solutions to the Triton Puzzles☆18Updated 9 months ago
- Directed masked autoencoders☆14Updated 2 years ago
- ☆15Updated 2 years ago
- Scripts for building and deploying ConceptNet, using Packer and Puppet☆10Updated 4 years ago