EleutherAI / pilev2Links
☆13Updated 2 years ago
Alternatives and similar repositories for pilev2
Users that are interested in pilev2 are comparing it to the libraries listed below
Sorting:
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆114Updated last year
- M4 experiment logbook☆57Updated 2 years ago
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Experiments for efforts to train a new and improved t5☆75Updated last year
- ☆44Updated 11 months ago
- Utilities for Training Very Large Models☆58Updated last year
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated 2 years ago
- Companion repository to "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models"☆14Updated 2 years ago
- Code repository for the c-BTM paper☆107Updated 2 years ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated 2 years ago
- ☆76Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- ☆55Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated 2 years ago
- ☆26Updated last year
- ☆81Updated last year
- ☆39Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆43Updated last year
- LL3M: Large Language and Multi-Modal Model in Jax☆74Updated last year
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆88Updated last year
- ☆62Updated 3 years ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- ☆69Updated last year
- Latent Diffusion Language Models☆68Updated 2 years ago
- ☆65Updated 2 years ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆52Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year