rovle / gpt3-in-context-fitting
Experiments on GPT-3's ability to fit numerical models in-context.
☆14Updated 2 years ago
Alternatives and similar repositories for gpt3-in-context-fitting:
Users that are interested in gpt3-in-context-fitting are comparing it to the libraries listed below
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- ☆14Updated 11 months ago
- Embedding Recycling for Language models☆38Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 9 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆58Updated last year
- Efficient Scaling laws and collaborative pretraining.☆15Updated last month
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆23Updated last year
- ☆13Updated 3 years ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆33Updated 4 years ago
- PyTorch implementation for MRL☆18Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Automatically take good care of your preemptible TPUs☆36Updated last year
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- Few-shot Learning with Auxiliary Data☆27Updated last year
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆24Updated 4 years ago
- Minimum Description Length probing for neural network representations☆19Updated last month
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 2 months ago
- Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"☆34Updated 2 years ago
- Evaluation of neuro-symbolic engines☆34Updated 7 months ago
- This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"☆27Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆18Updated last month
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆37Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆48Updated 3 years ago
- ☆44Updated 3 months ago
- Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.☆39Updated this week