Notes on Direct Preference Optimization
☆24Apr 14, 2024Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notes on the Mistral AI model☆20Dec 27, 2023Updated 2 years ago
- Notes and commented code for RLHF (PPO)☆127Feb 27, 2024Updated 2 years ago
- An Educational Framework Based on PyTorch for Deep Learning Education and Exploration☆11Dec 24, 2023Updated 2 years ago
- Source code of NAACL 2025 Findings "Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models"☆15Dec 16, 2025Updated 3 months ago
- Distributed training (multi-node) of a Transformer model☆94Apr 10, 2024Updated last year
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Apr 15, 2025Updated 11 months ago
- Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations☆13May 31, 2021Updated 4 years ago
- Registration-aided 3D Point Cloud Learning for Large-Scale Place Recognition (IROS 2021)☆11May 28, 2022Updated 3 years ago
- ☆12Oct 29, 2023Updated 2 years ago
- [ICML 2024] DPZero: Private Fine-Tuning of Language Models without Backpropagation☆16Sep 4, 2024Updated last year
- ☆14Aug 7, 2023Updated 2 years ago
- ☆14Nov 5, 2024Updated last year
- [SIGMOD2026] Reveal Hidden Pitfalls and Navigate Next Generation of Vector Similarity Search with Task-Centric Benchmarks☆24Dec 31, 2025Updated 2 months ago
- Collection of resources for RL and Reasoning☆27Feb 3, 2025Updated last year
- Graph Neural Convection-Diffusion with Heterophily☆11May 29, 2023Updated 2 years ago
- Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models☆31Oct 6, 2025Updated 5 months ago
- ☆26Mar 11, 2025Updated last year
- AnyAccomp: Generalizable accompaniment generation for vocals and solo instruments, powered by a quantized melodic bottleneck.☆35Dec 22, 2025Updated 3 months ago
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆50Aug 2, 2025Updated 7 months ago
- [COLM 2025] JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Model☆27Nov 25, 2025Updated 3 months ago
- Paper List for Gradient Inversion Attacks in Federated Learning [IEEE TPAMI 2026]☆31Mar 11, 2026Updated last week
- ☆20Mar 6, 2025Updated last year
- EfficientGS: Streamlining Gaussian Splatting for Large-Scale High-Resolution Scene Representation☆26Oct 30, 2024Updated last year
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆31Aug 14, 2025Updated 7 months ago
- CS Experience Labs' web application.☆21Feb 2, 2026Updated last month
- ☆15Aug 16, 2024Updated last year
- This Repository contains all my codes for preparing interview.☆13Nov 16, 2017Updated 8 years ago
- Library for simulating time progression in Python☆16Aug 16, 2025Updated 7 months ago
- ☆20Dec 6, 2024Updated last year
- ☆13May 9, 2024Updated last year
- [EMNLP 2024] FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents☆22Jan 6, 2025Updated last year
- ☆12Sep 21, 2023Updated 2 years ago
- Sortable table guidance for Leetcode questions using handlebars.js☆37Sep 13, 2014Updated 11 years ago
- Solve puzzles. Learn CUDA.☆62Dec 13, 2023Updated 2 years ago
- Understanding how features learned by neural networks evolve throughout training☆41Oct 24, 2024Updated last year
- ☆17May 6, 2025Updated 10 months ago
- Video about NP-completeness, circuit SAT and "reversing time"☆15Aug 18, 2024Updated last year
- Official implementation of ViT-5: Vision Transformers for The Mid-2020s☆89Feb 16, 2026Updated last month
- ☆16Dec 16, 2020Updated 5 years ago