ckkissane / rlhf-shakespeare
Shakespeare transformer fine-tuned to generate positive sentiment samples using RLHF
☆10Updated 2 years ago
Alternatives and similar repositories for rlhf-shakespeare:
Users that are interested in rlhf-shakespeare are comparing it to the libraries listed below
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- ☆24Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆28Updated last month
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- ☆27Updated this week
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- ☆44Updated 4 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 10 months ago
- ☆25Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆57Updated 11 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated 9 months ago
- ☆48Updated 4 months ago
- Minimum Description Length probing for neural network representations☆19Updated 2 months ago
- Here we provide and collect many functions to generate math problem and step by step solutions for LLM training☆17Updated last year
- ☆67Updated 8 months ago
- Efficient Scaling laws and collaborative pretraining.☆15Updated 2 months ago
- ☆31Updated 2 months ago
- NeurIPS 2024 tutorial on LLM Inference☆39Updated 3 months ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆12Updated last year
- Exploration of automated dataset selection approaches at large scales.☆34Updated 3 weeks ago
- ☆11Updated last year
- PyTorch implementation for MRL☆18Updated last year
- ☆40Updated 10 months ago
- ☆37Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 10 months ago