This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)
☆19Jan 9, 2025Updated last year
Alternatives and similar repositories for SFT-and-DPO
Users that are interested in SFT-and-DPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [WACV 2025] Exploiting VLM Localizability and Semantics for Open Vocabulary Action Detection☆17Mar 23, 2025Updated last year
- Official implementation of ICLR 2025 'LORO: Parameter and Memory Efficient Pretraining via Low-rank Riemannian Optimization'☆16Apr 24, 2025Updated 11 months ago
- [SIGMOD2026] Reveal Hidden Pitfalls and Navigate Next Generation of Vector Similarity Search with Task-Centric Benchmarks☆25Dec 31, 2025Updated 3 months ago
- Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)☆19Nov 22, 2024Updated last year
- HIPPO: Enhancing the Table Understanding Capability of Large Language Models through Hybrid-Modal Preference Optimization☆17May 29, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated 7 months ago
- ☆16Jul 12, 2024Updated last year
- 文本生成 - 通过商品参数和图片自动生成营销文本☆12Sep 17, 2021Updated 4 years ago
- 推荐系统BPRMF模型的Pytorch实现，基于MovieLens数据集☆11May 16, 2021Updated 4 years ago
- ☆27Dec 29, 2023Updated 2 years ago
- For D435i multicam hardware synchronization，get sensor data include color,depth,left,right,IMU.☆17Apr 19, 2024Updated 2 years ago
- Text Adventure Learning Environment Suite - Benchmark to evaluate language models on interactive text environments.☆26Apr 1, 2026Updated 2 weeks ago
- [EMNLP 2023] Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts☆27Nov 4, 2023Updated 2 years ago
- ☆18Nov 22, 2025Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Object tracking based on SiamFC & DaSiamRPN using GOT-10k toolkit. Demo & Visualization.☆10Jun 29, 2020Updated 5 years ago
- Multi-camera calibration (intrinsics, extrinsics, and bundle adjustment)☆14Nov 2, 2025Updated 5 months ago
- 基于deepsetAI的开源项目haystack进行修改，使其支持中文场景下的任务☆24Dec 11, 2023Updated 2 years ago
- 本工程代码用于批量实现公开人脸300w/lfpw/afw/helen人脸68个关键点检测训练数据的处理与增强操作，方便后续的训练工作☆16Aug 13, 2019Updated 6 years ago
- 2018 京东AI时尚挑战赛，时尚风格识别冠军（All source code ）☆12Sep 13, 2018Updated 7 years ago
- ☆16Mar 26, 2023Updated 3 years ago
- This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Dee…☆50Apr 11, 2026Updated last week
- A simple modification on the official DETR codebase with support to Finetune on custom dataset☆14Nov 26, 2020Updated 5 years ago
- ☆21Aug 18, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Automated prediction of treatment effectiveness in ovarian cancer using histopathological images☆15Sep 10, 2024Updated last year
- 自然语言处理_CCF大数据与计算智能大赛_面向数据安全治理的数据内容智能发现与分级分类☆11Nov 17, 2022Updated 3 years ago
- PyTorch implementation of IRMAE https//arxiv.org/abs/2010.00679☆48Jun 22, 2022Updated 3 years ago
- [ICML 2025] Official code of "AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization"☆31Jan 10, 2026Updated 3 months ago
- MSRSegNet: Multi-Scale Residual Network for Semantic Segmentation☆10Aug 9, 2018Updated 7 years ago
- 复现Wav2Lip作者新的论文☆20Jun 20, 2023Updated 2 years ago
- Driver State Monitoring 驾驶员状态监测，包括：人为遮挡、姿态异常、打哈欠、打电话、抽烟、分神、闭眼检测☆16May 26, 2023Updated 2 years ago
- 文档记录☆15Mar 16, 2021Updated 5 years ago
- [ICLR 2025] This is the code repo for our ICLR’25 paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rew…☆53Feb 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jun 3, 2020Updated 5 years ago
- ☆10Oct 23, 2017Updated 8 years ago
- This is a submission example for CelebA-Spoof Challenge participants.☆10Sep 8, 2020Updated 5 years ago
- Extract the key frame from the tested video, and then search the most similar Images from the database, which consists over 1,4000 pictur…☆10Mar 13, 2014Updated 12 years ago
- ☆14Jul 16, 2021Updated 4 years ago
- Code execution sandbox(support Open-R1), Supports multiple languages(Python/Java/C/Kotlin/Swift/OC/GO/...)☆23Mar 6, 2025Updated last year
- The quantization of CNN/LSTM☆11Mar 26, 2017Updated 9 years ago