Implementation of Direct Preference Optimization
☆17Jul 17, 2023Updated 3 years ago
Alternatives and similar repositories for DPO
Users that are interested in DPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Official implementation of Harnessing Mixed Offline Reinforcement Learning Datasets via Trajectory Reweighting☆16Feb 14, 2024Updated 2 years ago
- PyTorch implementations for Offline Preference-Based RL (PbRL) algorithms☆23Mar 24, 2025Updated last year
- Source for paper, "Data organization in spreadsheets"☆22Sep 30, 2021Updated 5 years ago
- Standalone library of frequently-used wrappers for dm_env environments.☆19Jul 9, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- Code for MOBILE: Model-Bellman Inconsistency Penalized Offline Policy Optimization☆22Apr 17, 2024Updated 2 years ago
- ☆14Jun 24, 2024Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆31Mar 12, 2024Updated 2 years ago
- [NeurIPS 2024] "AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment" by Yonggan Fu, Zhongzhi Yu,…☆19Dec 13, 2024Updated last year
- ☆14Sep 7, 2024Updated 2 years ago
- FID computation in Jax/Flax.☆29Jul 17, 2024Updated 2 years ago
- Database for International Physics Olympiads☆13Aug 3, 2026Updated 2 months ago
- Backup of the sources for my SJPO Teaching Notes☆11Apr 15, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Experiments to train transformer network to master reinforcement learning environments.☆32Mar 14, 2021Updated 5 years ago
- an R based software package that makes polygenic traits prediction using gradient boosted and LD adjusted gene score weights.☆10Apr 9, 2019Updated 7 years ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆15Jun 21, 2024Updated 2 years ago
- RLA is a tool for managing your RL experiments automatically☆71Feb 7, 2023Updated 3 years ago
- Some notes and solutions to "Machine Learning" authored by Zhi-Hua Zhou☆11Jul 20, 2021Updated 5 years ago
- In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy cust…☆16Feb 13, 2024Updated 2 years ago
- ☆10Sep 19, 2023Updated 3 years ago
- Starter template for your ML/AI projects (uv package manager, RestAPI with FastAPI and Dockerfile support)☆34Jan 13, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆27Oct 30, 2025Updated 11 months ago
- Code for the paper: Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains☆12Nov 12, 2021Updated 4 years ago
- Code for CascadeBERT, Findings of EMNLP 2021☆12Mar 30, 2022Updated 4 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Feb 20, 2024Updated 2 years ago
- ☆22Feb 4, 2026Updated 8 months ago
- Faster RCNN using TensorFlow☆10Jul 31, 2022Updated 4 years ago
- Processing WGS aDNA data using the ReichLab protocol☆13Mar 8, 2019Updated 7 years ago
- Adaptable Agent Populations via a Generative Model of Policies☆12Oct 14, 2021Updated 4 years ago
- self-adaptive in-context learning☆43May 5, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Feb 1, 2024Updated 2 years ago
- Datasets used in the paper "Reward hacking behavior can generalize across tasks"☆16Aug 17, 2025Updated last year
- 🛠Robust SSH: auto-reconnect SSH session that preserves your running shell and command. Intuitive, no server-side setup, aimed at simplic…☆14Nov 14, 2025Updated 10 months ago
- ☆17Mar 22, 2024Updated 2 years ago
- A cog model for the all-mpnet-base-v2 sentence-transformers embedding model.☆15Jan 3, 2024Updated 2 years ago
- Barebones Rust EVM Implementation☆12Feb 9, 2022Updated 4 years ago
- Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"☆41Jun 24, 2025Updated last year