Notes on Direct Preference Optimization
☆25Apr 14, 2024Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notes and commented code for RLHF (PPO)☆127Feb 27, 2024Updated 2 years ago
- ☆19May 11, 2024Updated last year
- An Educational Framework Based on PyTorch for Deep Learning Education and Exploration☆11Dec 24, 2023Updated 2 years ago
- Source code of NAACL 2025 Findings "Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models"☆15Dec 16, 2025Updated 3 months ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆17Apr 15, 2025Updated 11 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations☆13May 31, 2021Updated 4 years ago
- UniPrompt provides a unified interface to prompt optimization. We have distilled common functions from different algorithms and provide a…☆19May 20, 2025Updated 10 months ago
- ☆12Oct 29, 2023Updated 2 years ago
- [ICML 2024] DPZero: Private Fine-Tuning of Language Models without Backpropagation☆17Sep 4, 2024Updated last year
- Seldon Core Operator for Kubernetes☆13Nov 5, 2019Updated 6 years ago
- Implementation of GCNH, a GNN for heterophilous graphs described in the paper "GCNH: A Simple Method For Representation Learning On Heter…☆12Apr 27, 2023Updated 2 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- [SIGMOD2026] Reveal Hidden Pitfalls and Navigate Next Generation of Vector Similarity Search with Task-Centric Benchmarks☆24Dec 31, 2025Updated 3 months ago
- The code for PosDiffNet☆12Feb 27, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆46May 24, 2025Updated 10 months ago
- Graph Neural Convection-Diffusion with Heterophily☆11May 29, 2023Updated 2 years ago
- Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models☆32Oct 6, 2025Updated 6 months ago
- Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)☆181Jan 7, 2024Updated 2 years ago
- Because it's there.☆16Sep 22, 2024Updated last year
- AnyAccomp: Generalizable accompaniment generation for vocals and solo instruments, powered by a quantized melodic bottleneck.☆36Dec 22, 2025Updated 3 months ago
- ☆26Mar 11, 2025Updated last year
- ☆54Feb 19, 2025Updated last year
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆54Aug 2, 2025Updated 8 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Vero: An Open RL Recipe for General Visual Reasoning☆73Updated this week
- [COLM 2025] JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Model☆27Nov 25, 2025Updated 4 months ago
- Integrating SSE with NVIDIA Triton Inference Server using a Python backend and Zephyr model. There is very less documentation how to use …☆10May 29, 2024Updated last year
- ☆21Mar 6, 2025Updated last year
- ☆17Jun 2, 2020Updated 5 years ago
- EfficientGS: Streamlining Gaussian Splatting for Large-Scale High-Resolution Scene Representation☆25Oct 30, 2024Updated last year
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆31Aug 14, 2025Updated 7 months ago
- Library for simulating time progression in Python☆16Aug 16, 2025Updated 7 months ago
- Tutorial Kubernetes Operator☆16Aug 14, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆14May 9, 2024Updated last year
- Automated testing tool to find logic bugs in graph database systems☆21Oct 31, 2023Updated 2 years ago
- Benchmarking MIAs against LLMs.☆28Oct 8, 2024Updated last year
- ☆12Mar 4, 2025Updated last year
- 剑指Offer所有面试题C++11解法☆12May 29, 2018Updated 7 years ago
- My assignment solutions for Michigan’s EECS 498-008/598-008 (Deep Learning for Computer Vision) by Prof. Justin Johnson, version 2022☆20Mar 29, 2022Updated 4 years ago
- Video about NP-completeness, circuit SAT and "reversing time"☆15Aug 18, 2024Updated last year