anshradh / trl_custom
Applying Reinforcement Learning from Human Feedback to language models to teach them to write short story responses to writing prompts.
☆14Updated 2 years ago
Alternatives and similar repositories for trl_custom:
Users that are interested in trl_custom are comparing it to the libraries listed below
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- ☆14Updated 4 months ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- ☆44Updated 3 months ago
- Training a model without a dataset for natural language inference (NLI)☆25Updated 4 years ago
- ☆19Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 2 years ago
- The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…☆12Updated 3 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆48Updated 3 years ago
- Embedding Recycling for Language models☆38Updated last year
- ☆18Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- GASP! Dataset - Generating Abstracts of Scientific Papers from Abstracts of Cited Papers☆9Updated 4 years ago
- Converter from UD-trees to BART representation☆36Updated 11 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆25Updated 10 months ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated 2 years ago
- Minimum Description Length probing for neural network representations☆18Updated 3 weeks ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- Applying "Load What You Need: Smaller Versions of Multilingual BERT" to LaBSE☆18Updated 3 years ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20Updated 2 years ago
- ☆16Updated 4 years ago
- Implementation of Metaformer, but in an autoregressive manner☆23Updated 2 years ago
- ☆12Updated 2 years ago
- ☆15Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆46Updated last year