ckkissane / rlhf-shakespeare
Shakespeare transformer fine-tuned to generate positive sentiment samples using RLHF
☆10Updated last year
Related projects ⓘ
Alternatives and complementary repositories for rlhf-shakespeare
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- ☆28Updated 7 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆41Updated 10 months ago
- ☆24Updated last year
- ☆41Updated 2 weeks ago
- The repository contains code for Adaptive Data Optimization☆18Updated last month
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆71Updated 9 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆80Updated 11 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated 10 months ago
- ☆63Updated 4 months ago
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆39Updated 10 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- Minimum Description Length probing for neural network representations☆16Updated last week
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 6 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- Critique-out-Loud Reward Models☆38Updated last month
- ☆33Updated 6 months ago
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 7 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆61Updated 7 months ago
- ☆46Updated this week
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆58Updated 3 months ago
- PyTorch implementation for MRL☆18Updated 9 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- Efficient Scaling laws and collaborative pretraining.☆13Updated this week
- ☆22Updated last year