anshradh / trl_custom
Applying Reinforcement Learning from Human Feedback to language models to teach them to write short story responses to writing prompts.
☆14Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for trl_custom
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- ☆14Updated last month
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated last year
- ☆46Updated this week
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated last year
- Training a model without a dataset for natural language inference (NLI)☆25Updated 4 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆31Updated 5 months ago
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆24Updated 5 months ago
- ☆16Updated last year
- The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…☆12Updated 3 years ago
- This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…☆14Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 2 years ago
- ☆19Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆14Updated 3 years ago
- Entailment self-training☆25Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated last year
- Elevate your language models with insightful diversity metrics.☆10Updated 9 months ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- A set of methods for finding an appropriate number of topics in a text collection☆14Updated 3 months ago
- GASP! Dataset - Generating Abstracts of Scientific Papers from Abstracts of Cited Papers☆9Updated 4 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆23Updated 7 months ago
- Converter from UD-trees to BART representation☆36Updated 8 months ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆46Updated 3 years ago
- Advanced Reasoning Benchmark Dataset for LLMs☆45Updated last year
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- ☆12Updated 2 years ago
- ☆17Updated last year
- Source code for the GPT-2 story generation models in the EMNLP 2020 paper "STORIUM: A Dataset and Evaluation Platform for Human-in-the-Lo…☆39Updated 10 months ago
- Analogous Safe-state Exploration (ASE) is an algorithm for provably safe and optimal exploration in MDPs with unknown, stochastic dynamic…☆11Updated 3 years ago