DPO, but faster 🚀
☆51Dec 6, 2024Updated last year
Alternatives and similar repositories for dpo-prefix-sharing
Users that are interested in dpo-prefix-sharing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Feb 6, 2024Updated 2 years ago
- Demonstration of MoE distributed training using various techniques☆11Oct 31, 2024Updated 2 years ago
- This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.☆59Aug 13, 2024Updated 2 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆30Apr 17, 2024Updated 2 years ago
- ☆27Aug 28, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- rabitq rust implementation☆11May 14, 2026Updated 5 months ago
- ☆25Aug 20, 2025Updated last year
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Aug 5, 2024Updated 2 years ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆20May 27, 2025Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆78Aug 17, 2024Updated 2 years ago
- torch_remat fine-grained activation checkpointing API☆23Updated this week
- ☆50Nov 10, 2023Updated 2 years ago
- A curated and updated list of relevant articles and repositories on Reinforcement Learning from AI Feedback (RLAIF)☆12Jan 24, 2024Updated 2 years ago
- ☆118Jan 21, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A tool to slice your audio files into chunks using the Voice Activity Detection technique☆11Feb 13, 2023Updated 3 years ago
- Nearest Neighbor Normalization (EMNLP 2024)☆22Nov 1, 2024Updated 2 years ago
- Impact of typos and common misspellings on LLM task performance.☆25Mar 22, 2024Updated 2 years ago
- ☆16Feb 5, 2026Updated 9 months ago
- ☆38Jul 16, 2025Updated last year
- Experimental repository for research implementation of NoLoCo.☆31Mar 26, 2026Updated 7 months ago
- ☆16Jul 29, 2025Updated last year
- Universal Transformer with Memory Tokens. Pure JAX NNX. TPU-ready.☆13May 12, 2026Updated 5 months ago
- ☆59Apr 30, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment☆16Apr 13, 2022Updated 4 years ago
- ☆22Oct 13, 2026Updated 3 weeks ago
- Cleaned up code for reproducing our paper "The Quantization Model of Neural Scaling"☆10Oct 28, 2023Updated 3 years ago
- ☆84Jun 8, 2026Updated 4 months ago
- Simple repository for training small reasoning models☆53Aug 4, 2026Updated 3 months ago
- ☆15Jun 11, 2026Updated 4 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆54Jul 15, 2025Updated last year
- Evaluating Reward Models in Multilingual Settings (ACL Main '25)☆45May 16, 2025Updated last year
- Official implementation of "GPT or BERT: why not both?"☆65Jul 28, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆234Updated this week
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆52Jul 4, 2025Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- ☆36Mar 12, 2025Updated last year
- HPLT Analytics☆16Oct 16, 2026Updated 3 weeks ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Jan 16, 2023Updated 3 years ago
- Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"☆48May 13, 2026Updated 5 months ago